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Foreword 


Students at all levels of study in the theory of probability and in the theory 
of statistics will find in this book a broad and deep cross-section of problems 
(and their solutions) ranging from the simplest combinatorial probability prob- 
lems in finite sample spaces through information theory, limit theorems and the 
use of moments. 

The introductions to the sections in each chapter establish the basic 
formulas and notation and give a general sketch of that part of the theory that 
is to be covered by the problems to follow. Preceding each group of problems, 
there are typical examples and their solutions carried out in great detail. Each of 
these is keyed to the problems themselves so that a student seeking guidance in 
the solution of a problem can, by checking through the examples, discover the 
appropriate technique required for the solution. 

Bernard R. Gelbaum 
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I RANDOM EVENTS 


1. RELATIONS AMONG RANDOM EVENTS 


Basic Formulas 


Random events are usually designated by the letters A, B, C,..., U,V, 
where U denotes an event certain to occur and V an impossible event. The 
equality A = B means that the occurrence of one of the events inevitably brings 
about the occurrence of the other. The intersection of two events A and B is 
defined as the event C = AB, said to occur if and only if both events A and B 
occur. The union of two events A and B is the event C = A VU B, said to occur 
if and only if at least one of the events A and B occurs. The difference of two 
events A and B is defined as the event C = A\ B, said to occur if and only if 
A occurs and B does not occur. The complementary event is denoted by the 
same letter as the initial event, but with an over bar. For instance, A and A 
are complementary, A meaning that A does not occur. Two events are said to 
be mutually exclusive if AB = V. The events A, (kK = 1,2,...,) are said to 
form a complete set if the experiment results in at least one of these events so 
that Uf.1 A, = U. 


SOLUTION FOR TYPICAL EXAMPLES 


Example 1.1 What kind of events A and B will satisfy the equality 
AUB=A? 


SOLUTION. The union A U B means the occurrence of at least one of the 
events A and &. Then, for A U B = A, the event A must include the event B. 
For example, if A means falling into region S, and B falling into region Sj, 
then Sz lies within S,. 

The solution to Problems 1.1 to 1.3 and 1.8 is similar. 


Example 1.2 Two numbers at random are selected from a table of random 
numbers. If the event A means that at least one of these numbers is prime and 
the event B that at least one of them is an even number, what is the meaning of 
events AB and A U B? 


SOLUTION. Event AB means that both events A and B occur. The event 
A U B means that at least one of the two events occurs; that is, from two selected 
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numbers at least one number is prime or one is even, or one number is prime 
and the other is even. 
One can solve Problems 1.4 to 1.7 analogously. 


Example 1.3. Prove that AB = AU Band CU D = CD. 


Proor. If C = A and D = B, the second equality can be written in the 
form A U B = AB. Hence it suffices to prove the validity of the first equality. 
The event AS means that both events A and B do not occur. The comple- 
mentary event AB means that at least one of these events occurs: the union 
AUB. Thus AB = A UB. The proof of this equality can also be carried out 


geometrically, an event meaning that a point falls into a certain region. 
One can solve Problem 1.9 similarly. The equalities proved in Example 1.3 


are used in solving Problems 1.10 to 1.14. 

Example 1.4 The scheme of an electric circuit between points M and N 
is represented in Figure |. Let the event A be that the element a is out of order, 
and let the events B, (kK = 1, 2, 3) be that an element 6, is out of order. Write 
the expressions for C and C, where the event C means the circuit is broken 
between M and N. 


SOLUTION. The circuit is broken between M and N if the element a or the 
three elements 5, (kK = 1, 2,3) are out of order. The corresponding events are 


A and B,B,B,. Hence C = A VU B, BBs. 
Using the equalities of Example 1.3, we find that 
C = A U B,B,B; ae AB, BBs — A(B, U By U B3). 


Similarly one can solve Problems 1.16 to 1.18. 


PROBLEMS 


1.1 What meaning can be assigned to the events A U A and AA? 

1.2 When does the equality AB = A hold? 

1.3. A target consists of 10 concentric circles of radius r;, (kK = 1, 2, 
3,..., 10). An event A, means hitting the interior of a circle of radius 
r, (k = 1, 2,..., 10). What do the following events mean: 


6 10 
B= |) As C27 At 
1 k= 5 


1.4 Consider the following events: A that at least one of three 
devices checked is defective, and B that all devices are good. What is the 


meaning of the events (a) A U B, (b) AB? 


W FIGURE 1 
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1.5 The events A, B and C mean selecting at least one book 
from three different collections of complete works; each collection 
consists of at least three volumes. The events A, and 8, mean that s 
volumes are taken from the first collection and &k volumes from the 
second collection. Find the meaning of the events (a) AUBUC, 
(b) ABC, (c) A, U Bs, (d) AzBo, (e) (A, B3 U By A3)C. 

1.6 A number is selected at random from a table of random 
numbers. Let the event A be that the chosen number is divisible by S, 
and let the event B be that the chosen number ends with a zero. Find the 
meaning of the events A\ Band AB. 

1.7 Let the event A be that at least one out of four items is de- 
fective, and let the event B be that at least two of them are defective. 
Find the complementary events A and B. 

1.8 Simplify the expression A = (BUC)(BUC)(BUC). 

1.9 When do the following equalities hold true: (a) AU B = A, 
(b) AB = A, (c) AU B = AB? 

1.10 From the following equality find the random event X: 


XA IA = B: 


1.11 Prove that ABU AB = AB. 
1.12 Prove that the following two equalities are equivalent: 








4k = OU ko U «= I] Ax. 


1.13. Can the events A and A U B be simultaneous? 

1.14 Prove that A, AB and A U B forma complete set of events. 

1.15 Two chess players play one game. Let the event A be that the 
first player wins, and let B be that the second player wins. What event 
should be added to these events to obtain a complete set? 

1.16 An installation consists of two boilers and one engine. Let the 
event A be that the engine is in good condition, let B, (A = 1, 2) be that 
the Ath boiler is in good condition, and let C be that the installation can 
operate if the engine and at least one of the boilers are in good con- 
dition. Express the events C and C in terms of A and B,,. 

1.17 A vessel has a steering gear, four boilers and two turbines. 
Let the event A be that the steering gear is in good condition, let 
B, (k = 1, 2, 3, 4) be that the boiler labeled & is in good condition, 
let C; (j = 1, 2) be that the turbine labeled j is in good condition, and 
let D be that the vessel can sail if the engine, at least one of the boilers 
and at least one of the turbines are in good condition. Express D and D 
in terms of A and B,. 

1.18 A device is made of two units of the first type and three units 
of the second type. Let A, (kA = 1, 2) be that the Ath unit of the first 
type is in good condition, let B; (j = 1, 2, 3) be that the jth unit of the 
second type is in good condition, and let C be that the device can operate 

if at least one unit of the first type and at least two units of the second type 
are In good condition. Express the event C in terms of A, and B;. 
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2. A DIRECT METHOD FOR EVALUATING PROBABILITIES 


Basic Formulas 


If the outcomes of an experiment form a finite set of n elements, we shall 
say that the outcomes are equally probable if the probability of each outcome 
is 1/n. Thus if an event consists of m outcomes, the probability of the event 
is p = m/n. 


SOLUTION FOR TYPICAL EXAMPLES 


Example 2.1. A cube whose faces are colored is split into 1000 small cubes 
of equal size. The cubes thus obtained are mixed thoroughly. Find the probability 
that a cube drawn at random will have two colored faces. 


SOLUTION. The total number of small cubes is n = 1000. A cube has 12 
edges so that there are eight small cubes with two colored faces on each edge. 
Hence m = 12-8 = 96, p = m/n = 0.096. 

Similarly one can solve Problems 2.1 to 2.7. 


Example 2.2 Find the probability that the last two digits of the cube of a 
random integer will be 1.? 


SOLUTION. Represent N in the form N = a+ 106 +---, where a,b,... 
are arbitrary numbers ranging from 0 to 9. Then N? = a? + 30a2b +---. From 
this we see that the last two digits of N° are affected only by the values of a and b. 
Therefore the number of possible values is n = 100. Since the last digit of N° 
is a I, there is one favorable value a = |. Moreover, the last digit of (N* — 1)/10 
should be 1; i.e., the product 35 must end with a 1. This occurs only if b = 7. 
Thus the favorable value (a = 1, b = 7) is unique and, therefore, p = 0.01. 

Similarly one can solve Problems 2.8 to 2.11. 


Example 2.3. From a lot of n items, k are defective. Find the probability 
that / items out of a random sample of size m selected for inspection are defective. 


SOLUTION. The number of possible ways to choose m items out of n is 
Cr. The favorable cases are those in which / defective items among the k 
defective items are selected (this can be done in Cj, ways), and the remaining 
m — litems are nondefective, i.e., they are chosen from the total number n — k 
(in C@—-} ways). Thus the number of favorable cases is Ci),C7=}. The required 
probability will be p = (C!,C?>)/C™. 

One can solve Problems 2.12 to 2.20 similarly. 


Example 2.4 Five pieces are drawn from a complete domino set. 
Find the probability that at least one of them will have six dots marked on it. 


SOLUTION. Find the probability g of the complementary event. Then 

p = 1 —q. The probability that all five pieces will not have a six (see Example 
2.3) isg = (C?C3,)/C3, and, hence, 

Chi 

~~ 5 


28 


p=!l = 0.793. 


1 By a “random number” here we mean a k-digit number (& > 1) such that any of 
its digits may range from 0 to 9 with equal probability. 
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By a similar passage to the complementary event, one can solve Problems 
2.21 and 2.22. 


PROBLEMS 


2.1 Lottery tickets for a total of n dollars are on sale. The cost of 
one ticket is r dollars, and m of all tickets carry valuable prizes. Find 
the probability that a single ticket will win a valuable prize. 

2.2 A domino piece selected at random is not a double. Find the 
probability that the second piece also selected at random, will match the 
first. 

2.3. There are four suits in a deck containing 36 cards. One card 
is drawn from the deck and returned to it. The deck is then shuffled 
thoroughly and another card is drawn. Find the probability that both 
cards drawn belong to the same suit. 

2.4 A letter combination lock contains five disks on a common 
axis. Each disk is divided into six sectors with different letters on each 
sector. The lock can open only if each of the disks occupies a certain 
position with respect to the body of the lock. Find the probability that 
the lock will open for an arbitrary combination of the letters. 

2.5 The black and white kings are on the first and third rows, 
respectively, of a chess board. The queen is placed at random in one of 
the free squares of the first or second row. Find the probability that the 
position for the black king becomes checkmate if the positions of the 
kings are equally probable in any squares of the indicated rows. 

2.6 A wallet contains three quarters and seven dimes. One coin is 
drawn from the wallet and then a second coin, which happens to be a 
quarter. Find the probability that the first coin drawn is a quarter. 

2.7 From a lot containing m defective items and n good ones, s 
items are chosen at random to be checked for quality. As a result of this 
inspection, one finds that the first k of s items are good. Determine 
the probability that the next item will be good. 

2.8 Determine the probability that a randomly selected integer N 
gives as a result of (a) squaring, (b) raising to the fourth power, 
(c) multiplying by an arbitrary integer, a number ending with a |. 

2.9 On 10 identical cards are written different numbers from 0 to 
9. Determine the probability that (a) a two-digit number formed at 
random with the given cards will be divisible by 18, (b) a random three- 
digit number will be divisible by 36. 

2.10 Find the probability that the serial number of a randomly 
chosen bond contains no identical digits if the serial number may be any 
five-digit number starting with 00001. 

2.11. Ten books are placed at random on one shelf. Find the 
probability that three given books will be placed one next to the other. 

2.12 The numbers 2, 4, 6, 7, 8, 11, 12 and 13 are written, respec- 
tively, on eight indistinguishable cards. Two cards are selected at random 
from the eight. Find the probability that the fraction formed with these 

two random numbers is reducible. 
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2.13 Given five segments of lengths 1, 3, 5, 7 and 9 units, find the 
probability that three randomly selected segments of the five will be the 
sides of a triangle. 

2.14 Two of 10 tickets are prizewinners. Find the probability that 
among five tickets taken at random (a) one is a prizewinner, (b) two are 
prizewinners, (c) at least one is a prizewinner. 

2.15 This is a generalization of Problem 2.14. There are n + m 
tickets of which » are prizewinners. Someone purchases k tickets at the 
same time. Find the probability that s of these tickets are winners. 

2.16 Ina lottery there are 90 numbers, of which five win. By agree- 
ment one can bet any sum on any one of the 90 numbers or any set of 
two, three, four or five numbers. What is the probability of winning in 
each of the indicated cases? 

2.17 To decrease the total number of games, 2” teams have been 
divided into two subgroups. Find the probability that the two strongest 
teams will be (a) in different subgroups, (b) in the same subgroup. 

2.18 A number of 7 persons are seated in an auditorium that can 
accommodate n + k people. Find the probability that m <n given 
seats are occupied. 

2.19 Three cards are drawn at random from a deck of 52 cards. 
Find the probability that these three cards are a three, a seven and an ace. 

2.20 Three cards are drawn at random from a deck of 36 cards. 
Find the probability that the sum of points of these cards is 21 if the jack 
counts as two points, the queen as three points, the king as four points, the 
ace as eleven points and the rest as six, seven, eight, nine and ten points. 

2.21 Three tickets are selected at random from among five tickets 
worth one dollar each, three tickets worth three dollars each and two 
tickets worth five dollars each. Find the probability that (a) at least two 
of them have the same price, (b) all three of them cost seven dollars. 

2.22 There are 2n children in line near a box office where tickets 
priced at a nickel each are sold. What is the probability that nobody will 
have to wait for change if, before a ticket is sold to the first customer, the 
cashier has 2m nickels and it is equally probable that the payments for 
each ticket are made by a nickel or by a dime. 


3. GEOMETRIC PROBABILITIES 


Basic Formulas 


The geometric definition of probability can be used only if the probability 
of hitting any part of a certain domain is proportional to the size of this domain 
(length, area, volume, and so forth), and is independent of its position and shape. 

If the geometric size of the whole domain equals S, the geometric size of a 
part of it equals S;, and a favorable event means hitting S,, then the probability 
of this event is defined to be 

_ Ss 
Sie 


The domains can have any number of dimensions. 


3. GEOMETRIC PROBABILITIES oi 
SOLUTION FOR TYPICAL EXAMPLES 


Example 3.1 The axes of indistinguishable vertical cylinders of radius r 
pass through an interval / of a straight line AB, which lies in a horizontal plane. 
A ball of radius R is thrown at an angle q to this line. Find the probability that 
this ball will hit one cylinder if any intersection point of the path described by 
the center of the ball with the line AB is equally probable. ? 


SOLUTION. Let x be the distance from the center of the ball to the nearest 
line that passes through the center of a cylinder parallel to the displacement 
direction of the center of the ball. The possible values of x are determined by 
the conditions (Figure 2) 


0<x<5lsing. 


The collision of the ball with the cylinder may occur only if0 < x < R+ rr. 

The required probability equals the ratio between the length of the segment 
on which lie the favorable values of x and the length of the segment on which 
lie all the values of x. Consequently, 


2(R +r) ee 
por ee a ee ms . 
_ | Tsing for R+r<5sing; 
l for R+r>Ssing 


One can solve problems 3.1 to 3.4 and 3.24 analogously. 


Example 3.2. On one track of a magnetic tape 200 m. long some informa- 
tion is recorded on an interval of length 20 m., and on the second track similar 
information is recorded. Estimate the probability that from 60 to 85 m. there is 
no interval on the tape without recording if the origins of both recordings are 
located with equal probability at any point from 0 to 180 m. 


SOLUTION. Let x and y be the coordinates of origin of the recordings, 
where x > y. Since 0 < x < 180, 0 < y < 180 and x > y, the domain of all 
the possible values of x and y is a right triangle with hypotenuse 180 m. The 
area of this triangle is S = 1/2-180? sq. m. Find the domain of values of x and y 


FIGURE 2 





2 The restriction of equal probability used in formulating several problems with a 
point that hits the interior of any part of a domain (linear, two-dimensional, and so forth) 
is understood only in connection with the notion of geometric probability. 
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FIGURE 3 
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favorable to the given event. To obtain a continuous recording, it is necessary 
that the inequality x — y < 20 m. hold true. To obtain a recording interval 
longer than or equal to 25 m., we must have x — y > 5 m. Moreover, to obtain 
a continuous recording on the interval from 60 to 85 m., we must have 


45m. < y < 60m., 
65m. < x < 80m. 


Drawing the boundaries of the indicated domains, we find that the favorable 
values of x and y are included in a triangle whose area Sz = 1/2-15? sq. m. 
(Figure 3). The required probability equals the ratio of the area Sg favorable 
to the given event and the area of the domain S containing all possible values of 


x and y, namely, 
= (F5) ee 
P ~\780) ~ 144 


One can solve Problems 3.5 to 3.15 similarly. 


Example 3.3 It is equally probable that two signals reach a receiver at 
any instant of the time 7. The receiver will be jammed if the time difference in 
the reception of the two signals is less than 7. Find the probability that the 
receiver will be jammed. 


SOLUTION. Let x and y be the instants when the two signals are received. 
The domain of all the possible values of x, y is a square of area T? (Figure 4). 


FIGURE 4 
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FIGURE 5 





J 2 } 
S mf 


The receiver will be jammed if |x — y| < 7. The given domain lies between the 
straight lines x — y = r and x — y = —T. Its area equals 


S, = S —(T —- 7), 


2 
; 
p=1-(1~z): 


One can solve Problems 3.16 to 3.19 analogously. 


and, therefore, 


Example 3.4 Find the probability that the sum of two random positive 
numbers, each of which does not exceed one, will not exceed one, and that their 
product will be at most 2/9. 


SOLUTION. Let x and y be the chosen numbers. Their possible values are 
O<x<1,0<y<_ 1, defining in the plane a square of area S = |. The 
favorable values satisfy the conditions x + y < 1 and xy < 2/9. The boundary 
x + y = 1 divides the square in two so that the domain x + y < 1 represents 
the lower triangle (Figure 5). The second boundary xy = 2/9 is a hyperbola. 
The x’s of the intersection points of these boundaries are: x, = 1/3 and 
X_g = 2/3. The area of the favorable domain is 

1 34 ly dep ax. Pb. 2 
Spazt| ydrazts ce =3Tt In 2. 
The desired probability is p = S;/S = 0.487. 
One can solve Problems 3.20 to 3.23 in a similar manner. 


PROBLEMS 


3.1 A break occurs at a random point on a telephone line AB of 
length L. Find the probability that the point C is at a distance not less 
than / from the point A. 

3.2 Parallel lines are drawn in a plane at alternating distances 
of 1.5 and 8 cm. Estimate the probability that a circle of radius 2.5 cm. 
thrown at random on this plane will not intersect any line. 


10 
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3.3. In a circle of radius R chords are drawn parallel to a given 
direction. What is the probability that the length of a chord selected at 
random will not exceed R if any positions of the intersection points of 
the chord with the diameter perpendicular to the given direction are 
equally probable? 

3.4 In front of a disk rotating with a constant velocity we place a 
segment of length 2A in the plane of the disk so that the line joining the 
midpoint of the segment with the center of the disk is perpendicular to 
this segment. At an arbitrary instant a particle flies off the disk. Estimate 
the probability that the particle will hit the segment if the distance 
between the segment and the center of the disk is /. 

3.5 A rectangular grid is made of cylindrical twigs of radius r. 
The distances between the axes of the twigs are a and 6 respectively. 
Find the probability that a ball of diameter d, thrown without aiming, 
will hit the grid in one trial if the flight trajectory of the ball is perpen- 
dicular to the plane of the grid. 

3.6 A rectangle 3 cm. x 5 cm. is inscribed in an ellipse with the 
semi-axes a = 100 cm. and 6 = 10 cm. so that its larger side is parallel 
to a. Furthermore, one constructs four circles of diameter 4.3 cm. that 
do not intersect the ellipse, the rectangle and each other. 

Determine the probability that (a) a random point whose position 
is equally probable inside the ellipse will turn out to be inside one of the 
circles, (b) the circle of radius 5 cm. constructed with the center at this 
point will intersect at least one side of the rectangle. 

3.7. Sketch five concentric circles of radius kr, where k = 1, 2, 
3, 4, 5, respectively. Shade the circle of radius r and two annuli with the 
corresponding exterior radii of 3r and 5r. Then select at random a point 
in the circle of radius 5r. Find the probability that this point will be in 
(a) the circle of radius 2r, (b) the shaded region. 

3.8 A boat, which carries freight from one shore of a bay to the 
other, crosses the bay in one hour. What is the probability that a ship 
moving along the bay will be noticed if the ship can be seen from the 
boat at least 20 minutes before the ship intersects the direction of the 
boat and at most 20 minutes after the ship intersects the direction of 
the boat? All times and places for intersection are equally likely. 

3.9 Two points are chosen at random on a segment of length /. 
Find the probability that the distance between the points is less than ki, 
fO<k <1. 

3.10 Two points L and M are placed at random on a segment 
AB of length /. Find the probability that the point L is closer to M than 
to A. 

3.11 Ona segment of length /, two points are placed at random so 
that the segment is divided into three parts. Find the probability that 


these three parts of the segment are sides of a triangle. 


3.12 Three points A, B, C are placed at random on a circle of 
radius R. What is the probability that the triangle ABC is acute-angled? 

3.13 Three line segments, each of a length not exceeding /, are 
chosen at random. What is the probability that they can be used to form 
the sides of a triangle? 
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3.14 Two points M and N are placed on a segment AB of length /. 
Find the probability that the length of each of the three segments thus 
obtained does not exceed a given value a (/ > a > 1/3). 

3.15 A bus of line A arrives at a station every four minutes and a 
bus of line B every six minutes. The length of an interval between the 
arrival of a bus of line A and a bus of line B may be any number of 
minutes from zero to four, all equally likely. 

Find the probability that (a) the first bus that arrives belongs to 
line A, (b) a bus of any line arrives within two minutes. 

3.16 Two ships must arrive at the same moorings. The times of 
arrival for both ships are independent and equally probable during a 
given period of 24 hours. Estimate the probability that one of the ships 
will have to wait for the moorings to be free if the mooring time for the 
first ship is one hour and for the second ship two hours. 

3.17 Two persons have the same probability of arriving at a 
certain place at any instant of the interval 7. Find the probability that 
the time that a person has to wait for the other is at most t. 

3.18 Two ships are sailing in a fog, one along a bay of width L and 
the other across the same bay. Their velocities are v, and v2. The second 
ship emits sounds that can be heard at a distance d < L. Find the 
probability that the sounds will be heard on the first ship if the 
trajectories of the two ships may intersect with equal probabilities at 
any point. 

3.19 A bar of length / = 200 mm. is broken at random into pieces. 
Find the probability that at least one piece between two break-points 
is at most 10 mm. if the number of break-points is (a) two, (b) three, 
and a break can occur with equal probability at any point of the bar. 

3.20 Two arbitrary points are selected on the surface of a sphere 
of radius R. What is the probability that an arc of a great circle passing 
through these points will make an angle less than «, where « < 7? 

3.21 A satellite moves on an orbit between 60 degrees northern 
latitude and 60 degrees southern latitude. Assuming that the satellite 
can splash down with equal probability at any point on the surface of the 
earth between the previously mentioned parallels, find the probability 
that the satellite will fall above 30 degrees northern latitude. 

3.22 A plane is shaded by parallel lines at a distance L between 
adjacent lines. Find the probability that a needle of length /, where 
1 < L, thrown at random will intersect some line (Buffon’s problem). 

3.23 Estimate the probability that the roots of (a) the quadratic 
equation x? + 2ax + b = 0,(b) the cubic equation x* + 3ax + 2b =0 
are real, if it is known that the coefficients are equally likely in the 
rectangle |a| < n, |b| < m. Find the probability that under the given 
conditions the roots of the quadratic equation will be positive. 

3.24 A point A and the center B of a circle of radius R move in- 
dependently in a plane. The velocities of these points are constant and 
equal u and v. At a given instant, the distance AB equals r (r > R), and 
the angle made by the line AB with the vector v equals 8. Assuming that 
all directions for the point A are equally probable, estimate the proba- 
bility that the point A will be inside the circle. 
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4. CONDITIONAL PROBABILITY. THE MULTIPLICATION 
THEOREM FOR PROBABILITIES 
Basic Formulas 


The conditional probability P(A | B) of the event A is the probability of 
A under the assumption that the event B has occurred. (It is assumed that the 
probability of B is positive.) The events A and Bare independent if P(A | B) = 
P(A). The probability for the product of two events is defined by the formula 


P(AB) = P(A)P(B| A) = P(B)P(A | B), 


which, generalized for a product of events, is 


P(IL Ay) = P(A,)P(Az | Ai)P(Ag | 4142): - P(4, 





1,4) 


The events Aj, Ao,..., A, are said to be independent if for any m, where 
m = 2,3,...,n, and any k, (j = 1,2,...,m), 1 < ky < kp <-+-<k, <n, 


p(T Ax,) = TI P(A.). 


j= 


SOLUTION FOR TYPICAL EXAMPLES 


Example 4.1 The break in an electric circuit occurs when at least one out 
of three elements connected in series is out of order. Compute the probability 
that the break in the circuit will not occur if the elements may be out of order 
with the respective probabilities 0.3, 0.4 and 0.6. How does the probability 
change if the first element is never out of order? 


SOLUTION. The required probability equals the probability that all three 
elements are working. Let A, (K = 1, 2, 3) denote the event that the kth element 
functions. Then p = P(A,A,A3). Since the events may be assumed independent, 


p > P(A,)P(A,)P(A3) = 0.7-0.6-0.4 = 0.168. 
If the first element is not out of order, then 
p = P(A,A3) = 0.24. 
Similarly one can solve Problems 4.1 to 4.10. 


Example 4.2 Compute the probability that a randomly selected item is of 
first grade if it is known that 4 per cent of the entire production is defective, 
and 75 per cent of the nondefective items satisfy the first grade requirements. 

It is given that P(A) = 1 — 0.04 = 0.96, P(B| A) = 0.75. 

The required probability p = P(AB) = (0.96)(0.75) = 0.72. 

~ Similarly one can solve Problems 4.11 to 4.19. 


Example 4.3 A lot of 100 items undergoes a selective inspection. The 
entire lot is rejected if there is at least one defective item in five items checked. 
What is the probability that the given lot will be rejected if it contains 5 per cent 
defective items? 
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SOLUTION. Find the probability g of the complementary event A consisting 
of the situation in which the lot will be accepted. The given event is an inter- 
section of five events A = A,A,A3A,A5, where A, (kK = 1, 2,3, 4, 5) means that 
the kth item checked is good. 

The probability of the event A, is P(A,) = 95/100 since there are only 
100 items, of which 95 are good. 

After the occurrence of the event 4,, there remain 99 items, of which 94 
are good and, therefore, P(A. | A,) = 94/99. Analogously, P(A3 | A142) = 
93/98, P(A, | A,A2Aa) = 92/97 and P(A; | 41424344) = 91/96. According to 
the general formula, we find that 


95.94 93-92-91 


The required probability p = | — q = 0.23. 
One can solve Problems 4.20 to 4.35 similarly. 


PROBLEMS 


4.1. Two marksmen whose probabilities of hitting a target are 0.7 
and 0.8, respectively, fire one shot each. Find the probability that at 
least one of them will hit the target. 

4.2 The probability that the kth unit of a computer is out of order 
during a time T equals p, (kK = 1, 2,..., 7). Find the probability that 
during the given interval of time at least one of n units of this computer 
will be out of order if all the units run independently. 

4.3 The probability of the occurrence of an event in each per- 
formance of an experiment is 0.2. The experiments are carried out suc- 
cessively until the given event occurs. Find the probability that it will be 
necessary to perform a fourth experiment. 

4.4 The probability that an item made on the first machine is of 
first grade is 0.7. The probability that an item made on the second 
machine is first grade is 0.8. The first machine makes two items and the 
second machine three items. Find the probability that all items made 
will be of first grade. 

4.5. A break in an electric circuit may occur only if one element K 
or two independent elements K, and K, are out of order with respective 
probabilities 0.3, 0.2 and 0.2. Find the probability of a break in the 

circuit. 

4.6 A device stops as a result of damage to one tube of a total 
of N. To locate this tube one successively replaces each tube with a new 
one. Find the probability that it will be necessary to check n tubes if the 
probability is p that a tube will be out of order. 

4.7 How many numbers should be selected from a table of random 
numbers so that the probability of finding at least one even number 
among them is 0.9? 

4.8 The probability that as a result of four independent trials the 
event A will occur at least once is 0.5. Find the probability that the event 
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will occur in one trial if this probability is constant through all the other 
trials. 

4.9 Anequilateral triangle is inscribed in a circle of radius R. What 
is the probability that four points taken at random in the given circle are 
inside this triangle? 

4.10 Find the probability that a randomly written fraction will be 
irreducible (Chebyshev’s problem).* 

4.11 If two mutually exclusive events A and B are such that 
P(A)#0 and P(B)<0, are these events independent? 

4.12 The probability that the voltage of an electric circuit will 
exceed the rated value is p,. For an increase in the voltage, the proba- 
bility that an electric device will stop is pz. Find the probability that the 
device will stop as a result of an increase in the voltage. 

4.13. A motorcyclist in a race must pass through 12 obstacles 
placed along a course AB; he will stop at each of them with probability 
0.1. Knowing the probability 0.7 with which the motorcyclist passes 
from B to the final point C without stops, find the probability that no 
stops will occur on the segment AC. 

4.14 Three persons play a game under the following conditions: 
At the beginning, the second and third play in turns against the first. 
In this case, the first player does not win (but might not lose either) and 
the probabilities that the second and third win are both 0.3. If the first 
does not lose, he then makes one move against each of the other two 
players and wins from each of them with the probability 0.4. After this, 
the game ends. Find the probability that the first player wins from at 
least one of the other two. 

4.15 A marksman hits a target with the probability 2/3. If he 
scores a hit on the first shot, he is allowed to fire another shot at another 
target. The probability of failing to hit both targets in three trials is 0.5. 
Find the probability of failing to hit the second target. 

4.16 Some items are made by two technological procedures. In 
the first procedure, an item passes through three technical operations, 
and the probabilities of a defect occurring in these operations are 0.1, 
0.2 and 0.3. In the second procedure, there are two operations, and the 
probability of a defect occurring in each of them is 0.3. Determine 
which technology ensures a greater probability of first grade production 
if in the first case, for a good item, the probability of first grade pro- 
duction is 0.9, and in the second case 0.8. 

4.17 The probabilities that an item will be defective as a result of 
a mechanical and a thermal process are p, and po, respectively. The 
probabilities of eliminating defects are pg and p,, respectively. 

Find (a) how many items should be selected after the mechanical 
process in order to be able to claim that at least one of them can undergo 
the thermal process with a chance of eliminating the defect, (b) the 
probability that at least one of three items will have a nonremovable 
defect after passing through the mechanical and thermal processes. 


3 Consider that the numerator and denominator are randomly selected numbers from 
the sequence 1, 2,..., k, and set kK-> a. 
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4.18 Show that if the conditional probability P(A | B) exceeds the 
unconditional probability P(A), then the conditional probability 
P(B | A) exceeds the unconditional probability P(B). 

4.19 A target consists of two concentric circles of radius kr and nr, 
where k < n. If it is equally probable that one hits any part of the circle 
of radius nr, estimate the probability of hitting the circle of radius kr 
in two trials. 

4.20 With six cards, each containing one letter, one forms the 
word /atent. The cards are then shuffled and at random cards are drawn 
one at a time. What is the probability that the arrangement of letters 
will form the word talent? 

4.21 Amanhas forgotten the last digit of a telephone number and, 
therefore, he dials it at random. Find the probability that he must dial 
at most three times. How does the probability change if one knows that 
the last digit is an odd number? 

4.22 Some m lottery tickets out of a total of m are the winners. 
What is the probability of a winner in k purchased tickets? 

4.23 Three lottery tickets out of a total of 40,000 are the big 
prizewinners. Find (a) the probability of getting at least one big prize- 
winner (ticket) per 1000 tickets, (b) how many tickets should be 
purchased so that the probability of one big winner is at least 0.5. 

4.24 Six regular drawings of state bonds plus one supplementary 
drawing after the fifth regular one take place annually. From a total of 
100,000 serial numbers, the winners are 170 in each regular drawing 
and 270 in each supplementary one. Find the probability that a bond 
wins after ten years in (a) any drawing, (b) a supplementary drawing, 
(c) a regular drawing. 

4.25 Consider four defective items: one item has the paint 
damaged, the second has a dent, the third is notched and the fourth 
has all three defects mentioned. Consider also the event A that the first 
item selected at random has the paint damaged, the event B that the 
second item has a dent and the event C that the third item is notched. 
Are the given events independent in pairs or as a whole set? 

4.26 Let A;, Ac,..., A, be a set of events independent in pairs. 
Is it true that the conditional probability that an event occurs, computed 
under the assumption that other events of the same set have occurred, 
is the unconditional probability of this event? 

4.27. A square is divided by horizontal lines into n equal strips. 
Then a point whose positions are equally probable in the strip is taken 
in each strip. In the same way one draws n — | vertical lines. Find the 
probability that each vertical strip will contain only one point. 

4.28 A dinner party of 2” persons has the same number of males 
and females. Find the probability that two persons of the same sex will 
not be seated next to each other. 

4.29 A party consisting of five males and 10 females is divided at 
random into five groups of three persons each. Find the probability 
that each group will have one male member. 

4.30 Anurn contains n + m identical balls, of which n are white 
and m black, where m > n. A person draws balls 1 times, two balls at a 
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time, without returning them to the urn. Find the probability of drawing 
a pair of balls of different colors each time. 

4.31 Anurn contains n balls numbered from | to n. The balls are 
drawn one at a time without being replaced in the urn. What is the 
probability that in the first k draws the numbers on the balls will coincide 
with the numbers of the draws? 

4.32 An urn contains two kinds of balls, white ones and black 
ones. The balls are drawn one at a time until a black ball appears, and 
each time when a white ball is drawn it is returned to the urn together 
with two additional balls. Find the probability that in the first 50 trials 
no black balls will be drawn. 

4.33 There aren + mmen in line for tickets that are priced at five 
dollars each; n of these men have five-dollar bills and m, whe. 
m<n-+t 1, have ten-dollar bills. Each person buys only one ticket. 
The cashier has no money before the box office opens. What is the 
probability that no one in the line will have to wait for change? 

4.34 The problem is the same as in 4.33, but now the ticket costs 
one dollar and n of the customers have one-dollar bills whereas m have 
five-dollar bills, where 2m <n + 1. 

4.35 Of two candidates, No. | receives n votes whereas No. 2 
receives m (nm > m) votes. Estimate the probability that at all times 
during the vote count No. | will lead No. 2. 


5. THE ADDITION THEOREM FOR PROBABILITIES 


Basic Formulas 
The probability of the union of two events is given by 
P(A U B) = P(A) + P(B) — P(AB), 


which can be extended to a union of any number of events: 


P(U Ax) = 3, PUA) — "SS Pde) 
+78 SS Peay —- + e7P( TT As). 


k=1 j=k+1i=j+ 


For mutually exclusive events, the probability of a union of events is the 
sum of the probabilities of these events: that is, 


P(U, Ay) = 3, PAL): 


k=1 


SOLUTION FOR TYPICAL EXAMPLES 


Example 5.1 Find the probability that a lot of 100 items, of which five 
are defective, will be accepted in a test of a randomly selected sample containing 
half the lot if, to be accepted, the number of defective items in a lot of 50 cannot 
exceed one. 
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SOLUTION. Let A be the event denoting that there is no defective item 
among those tested and B that there is only one defective item. The required 
probability is p = P(A) + P(B). The events A and B are mutually exclusive. 
Thus p = P(A) + P(B). 

There are C28, ways of selecting 50 items from a total of 100. From 95 
nondefective items one can select 50 items in C33 ways. Therefore, P(A) = 
C32/C89,. Analogously P(B) = C}C42/C88,. Then 


C8 CCH 47-37 
CHC Bo 99-97 


Problems 5.1 to 5.12 are solved similarly. 








= 0.181. 


Example 5.2 The scheme of the electric circuit between two points M 
and N is given in Figure 6, Malfunctions during an interval of time T of different 
elements of the circuit represent independent events with the following 
probabilities (Table 1). 


TABLE 1 


Element Le Ly 


0.7 0.9 





Probability 


Find the probability of a break in the circuit during the indicated interval 
of time. 


SOLUTION. Denote by A, (j = 1,2) the event meaning that an element 
K; is out of order, by A that at least one element KX; is out of order and by B 
that all three elements L, (i = 1, 2, 3) are out of order. 
Then, the required probability is 


p = P(A VU B) = P(A) + P(B) — P(A)P(B). 
Since 
P(A) = P(A,) + P(4,) — P(A;)P(42) = 0.8, 
P(B) = P(L, )P(L2)P(Ls) = 0.252, 
we get p = 0.85. 
One can solve Problems 5.13 to 5.16 analogously. 


Example 5.3. The occurrence of the event A is equally probable at any 
instant of the interval 7. The probability that A occurs during this interval is p. 
It is known that during an interval t < 7, the given event does not occur. 


FIGURE 6 
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Find the probability P that the event A will occur during the remaining interval 
of time. 


SOLUTION. The probability p that the event A occurs during the interval 


abe. IE ‘ : ‘ 
T is the probability 7P that the given event occurs during time ¢ plus the product 


of the probability (1 — 7?) that A will not occur during ¢t by the conditional 


probability that it will occur during the remaining time if it did not occur 
before. Thus, the following equality holds true: 


t t 


From this we find 


Example 5.4 An urn contains n white balls, m black balls and / red balls, 
which are drawn at random one at a time (a) without replacement, (b) with 
replacement of each ball to the urn after each draw. Find the probability that 
in both cases a white ball will be drawn before a black one. 


SOLUTION. Let P; be the probability for a white ball to be drawn before a 
black one, and P,; be the probability for a black ball to be drawn before a 
white ball. 

The probability P, is the sum of probabilities of drawing a white ball 
immediately after a red ball, two red balls, and so forth. Thus, in the case without 
replacement we have 


_ n l n 
"RPL A nen ed 
I I—] n 
pray aw eg gee (am eT ae ae 


Py 
+ 


and in the case with replacement, 


n In l?n __h 


Py 


“ntmti’@imtiy t+ htmrp n+m 





To obtain the probabilities P,, replace n by m and m by n in the preceding 
formulas. From this it follows in both cases that P,:P;; = n:m. Furthermore, 
since P; + Py = 1, the required probability in the case without replacement is 
also P; = n/(n + m). 

, One can solve Problems 5.23 to 5.27 similarly. 


Example 5.5 A person wrote x letters, sealed them in envelopes and wrote 
the different addresses randomly on each of them. Find the probability that 
at least one of the envelopes has the correct address. 
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SOLUTION. Let the event A, mean that the kth envelope has the correct 
address, where k = 1,2,...,. The desired probability is p = P(\%-1 A;). 


The events A, are simultaneous; for any k, j, i,... the following equalities 
obtain: 
A. Ge It 
P(A,) = ni 
— 2)! 
P(A.A,) = P(A,)P(4; | 4,) = 27), 
me 
P(A,,A;A;) = ead — 
and finally, 
1 
P(TL 4s) = ar 
Using the formula for the probability of a sum of n events we obtain 
Ay op is Tr)! Se eas a)! gga ES eee a 13* i 
n! n} n! n! 
or 
1 1 fiers th 
p= 35 Peg ta ad) “att 


For large n, p ~ 1 — e7}. 
Similarly, one can solve Problems 5.32 to 5.38. 


PROBLEMS 


5.1 Any one of four mutually exclusive events may occur with the 
corresponding probabilities 0.012, 0.010, 0.006 and 0.002. Find the prob- 
ability that the outcome of an experiment is at least one of these events. 

5.2 A marksman fires one shot at a target consisting of a central 
circle and two concentric annuli. The probabilities of hitting the circle 
and the annuli are 0.20, 0.15 and 0.10, respectively. Find the probability 
of not hitting the target. 

5.3. A ball is thrown at a square divided into n? identical squares. 
The probability that the ball will hit a small square of the horizontal 
strip 7 and vertical strip 71s p;; (>2j=1 Pi; = 1). Find the probability that 
the bal] will hit a horizontal strip. 

5.4 Two identical coins of radius r are placed inside a circle of 
radius R at which a point is thrown at random. Find the probability 
that this point hits one of the coins if the coins do not overlap. 

5.5 What is the probability of drawing from a deck of 52 cards 
a face card (jack, queen or king) of any suit or a queen of spades? 

5.6 A box contains ten 20-cent stamps, five 15-cent stamps and 
two 10-cent stamps. One draws six stamps at random. What is the 
probability that their sum does not exceed one dollar (100 cents)? 

5.7 Given the probabilities of the events A and AB, find the 
probability of the event AB. 
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5.8 Prove that from the condition 
P(B| A) = P(B| A) 


it follows that the events A and B are independent. 

5.9 The event B includes the event A. Prove that P(A) < P(B). 

5.10 Two urns contain balls differing only in color. The first urn 
has five white, 11 black and eight red balls, the second has 10 white, 
eight black and six red balls. One ball at a time is drawn at random 
from both urns. What is the probability that both balls will be of the 
same color? 

5.11 Two parallel strips 10 mm. wide are drawn in the plane at a 
distance of 155 mm. Along a perpendicular to these strips, at a 
distance of 120 mm. lie the centers of circles of radius 10 mm. Find the 
probability that at least one circle will cross one of the strips if the centers 
of the circles are situated along the line independent of the position of 
the strips. 

5.12 The seeds of n plants are sown in a line along the road at 
equal distances from each other. The probability that a pedestrian 
crossing the road at any point will damage one plant is p (p < 1/n). 
Find the probability that the mth pedestrian who crosses the road at a 
nonpredetermined point will damage a plant if the pedestrians cross the 
road successively and independently. 

5.13. Find the probability that a positive integer randomly selected 
will be nondivisible by (a) two and three (b) two or three. 

5.14 The probability of purchasing a ticket in which the sums of 
the first and last three digits are equal is 0.05525. What is the probability 
of receiving such a ticket among two tickets selected at random if both 
tickets (a) have consecutive numbers, (b) are independent of each other. 

5.15 Prove that if P(A) = a and P(B) = 3, then 


P(A | B) > avont 

5.16 Given that P(X < 10) = 0.9, P(|Y| < 1) = 0.95, prove 
that regardless of the independence of X and Y if Z = X + Y, then 
the following inequalities hold: 


P(Z <11)>085, P(Z <9) < 0.95. 


5.17 A game between A and B is conducted under the following 
rules: as a result of the first move, always made by A, he can win with 
the probability 0.3; if A does not win in the first move, B plays next and 
can win with the probability 0.5; ifin this move B does not win, A makes 
the next move, in which he can win with the probability 0.4. Find the 
probabilities of winning for A and B. 

5.18 Given the probability p that a certain sportsman improves 
his previous score in one trial, find the probability that the sportsman 
will improve his score in a competition in which two trials are allowed. 
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5.19 Player A plays two games each in turn with players B and C. 
The probabilities that the first game is won by B and C are 0.1 and 0.2, 
respectively; the probability that the second game is won by B is 0.3, 
and by C, 0.4. 

Find the probability that (a) B wins first, (b) C wins first. 

5.20 From an urn containing » balls numbered from 1 to » two 
balls are drawn successively; the first ball is returned to the urn if its 
number is 1. Find the probability that the ball numbered 2 is drawn on 
the second trial. 

5.21 Player A plays in turn with players B and C with the prob- 
ability of winning in each game 0.25; he ends the game after the first loss 
or after two games played with each of the other players. Find the 
probabilities that B and C win. 

5.22 The probability that a device breaks after it has been used k 
times is G(x). Find the probability that the device is out of order after n 
consecutive uses if during the previous m operations it was not out of 
order. 

5.23. Two persons alternately flip a coin. The one who gets heads 
first is the winner. Find the probabilities of winning for each player. 

5.24 Three persons successively toss a coin. The one who gets 
heads first is the winner. Find the probabilities of winning for each 
player. 

5.25 The probability of gaining a point without losing service in a 
game between two evenly matched volleyball teams is 0.5. Find the 
probability that the serving team will gain a point. 

5.26 An urn contains ” white and m black balls. Two players suc- 
cessively draw one ball at a time and each time return the ball to the urn. 
The game continues until one of them draws a white ball. Find the prob- 
ability that the white ball will be first drawn by the player who starts the 
game. 

5.27. Two marksmen shoot in turn until one of them hits the 
target. The probability of hitting the target is 0.2 for the first marksman 
and 0.3 for the second one. Find the probability that the first marksman 
fires more shots than the second. 

5.28 Prove the validity of the equality 


P( Ti Ay) aah P(U A). 


5.29 Simplify the general formula for the probability of a union 
of events applicable to the case when the probabilities for products of 
equal numbers of events coincide. 

5.30 Prove that 


P( Tl Ay) - 2 PAL) = > 2. aA? 


n-2 n-1 


Ae De aD > P(A, U ASU A) — 


k=17=k4+1i=7+ 
+(-e(U Ay). 
=1 


k 
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5.31 Prove that for any events A, (k = 0,1,..., 7) the following 
equality holds true: 


P(o TI As) = Pe) — 3 Poo A) 


n-1 n pe n 
i Pc A, TA) = + (1 U Ay). 
k=1j=k+1 k=0 


5.32 Anurn contains n balls numbered from | to n. The balls are 
drawn from the urn one at a time without replacement. Find the prob- 
ability that in some draw the number on the ball coincides with the 
number of the trial. 

5.33. An auditorium has 7 numbered seats; n tickets are distributed 
among ” persons. What is the probability that m persons will be seated 
at seats that correspond to their ticket numbers if all the seats are occu- 
pied at random. 

5.34 A train consists of n cars; k (k > n) passengers get on it and 
select their cars at random. Find the probability that there will be at least 
one passenger in each car. 

5.35. Two persons play until there is a victory, which occurs when 
the first wins m games or the second n games. The probability that a 
game is won is p for the first player and g = 1 — p for the second. Find 
the probability that the whole competition is won by the first player. 

5.36 Two persons have agreed that a prize will go to the one who 
wins a given number of games. The game is interrupted when m games 
remain to be won by the first player and n by the second. How should the 
stakes be divided if the probability of winning a game is 0.5 for each 
player? 

5.37 This is the problem of four liars. One person (a) out of four 
a, b, c and d receives information that he transmits in the form of a 
“ves” or “no” signal to the second person (6). The second person 
transmits to the third (c), the third to the fourth (d) and the fourth 
communicates the received information in the same manner as all the 
others. Given the fact that only one person in three tells the truth, find 
the probability that the first liar tells the truth if the fourth told the 
truth. 

5.38 Some parallel lines separated by the distance L are drawn 
in a horizontal plane. A convex contour of perimeter s is randomly 
thrown at this plane. Find the probability that it will intersect one of the 
parallels if the diameter of the smallest circle circumscribed about the 
contour is less than L. 


6. THE TOTAL PROBABILITY FORMULA 


Basic Formulas 


The probability P(A) that an event A will occur simultaneously with one 
of the events H,, Ho,..., H, forming a complete set of mutually exclusive 
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events (hypotheses) is given by the total probability formula 


P(A) = > PCH,)PCA | Hh), 
where 
2 PU) = 1. 


SOLUTION FOR TYPICAL EXAMPLES 


Example 6.1 Among ” persons, m < n prizes are distributed by random 
drawing in turn from a box containing 7 tickets. Are the chances of winning 
equal] for all participants? When is it best to draw a ticket? 


SOLUTION. Denote by A, the event that consists of drawing a winning 
ticket in k draws from the box. According to the results of the preceding 
experiments, one can make k + 1 hypotheses. Let the hypothesis H;,, mean 
that among & drawn tickets, s are prizewinners. The probabilities of these 
hypotheses are 
CiCh—m 

Cr 


P(7,,;) = (s = 0, ears. 2 


where 
P(H,;) = 0, if s>m. 


Since there are n — k tickets left, of which m — s are winners, form > s 


m— $ 


P(A, | His) = WHE 


By the total probability formula, we find 


where C5, = O fors > m. 
This equality can also be written in the form 








s=0 Choa 
We have 
k 1 k dsy™-3 qk-syn-m™ 
s K=>-8,n—-—k-1 — s 
2 Cmm-1Cn= ni kl 2 Ce he aa 
ld® dtu} a 
= rica 14” )= ae et Oi Pi aaa 
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The required probability P(A,) = m/n for any k. Therefore, all participants 
have equal chances and the sequence in which the tickets are drawn is not 
important. 

Analogously, one can solve Problems 6.1 to 6.17. 


Example 6.2. A marked ball can be in the first or second of two urns with 
probabilities p and 1 — p. The probability of drawing the marked ball from the 
urn in which it is located is P(P # 1). What is the best way to use n draws of 
balls from any urn so that the probability of drawing the marked ball is largest 
if the ball is returned to its urn after each draw? 


SOLUTION. Denote by A the event consisting of drawing the marked ball. 
The hypotheses are H, that the ball is in the first urn, H, that the ball is in the 
second urn. By assumption P(H,) = p, P(H.) = 1 — p. If m balls are drawn 
from the first urn and » — m balls from the second urn, the conditional 
probabilities of drawing the marked ball are 

P(A | H,)=1- (1 —-P)*, P(A | 4.) =1—( —- Pj)". 
According to the total probability formula, the required probability is 
P(A) = pil a PY ap = he SB 


One should find m so that the probability P(A) is largest. Differentiating P(A) 
with respect to m (to find an approximate value of m, we assume that m is a 
continuous variable), we obtain 


AA _ pc — Pyrin (dl — P) + 0 — pl — Py In (l — P). 
Setting dP(A)/dm = 0, we get the equality (1 — P)?"-" = (1 — p)/p. Thus, 
In 2 
n Pp 


n= 


2 Din Py, 


The preceding formula is used in solving Problems 6.18 and 6.19. 





PROBLEMS 


6.1 There are two batches of 10 and 12 items each and one defec- 
tive item in each batch. An item taken at random from the first batch is 
transferred to the second, after which one item is taken at random from 
the second batch. Find the probability of drawing a defective item from 
the second batch. 

6.2 Two domino pieces are chosen at random from a complete 
set. Find the probability that the second piece will match the first. 

6.3 Two urns contain, respectively, m, and mz white balls and n, 
and n, black balls. One ball is drawn at random from each urn and 
then from the two drawn balls one is taken at random. What is the 
probability that this ball will be white? 

6.4 There are n urns, each containing m white and k black balls. 
One ball is drawn from the first urn and transferred to the second urn. 


THE TOTAL PROBABILITY FORMULA 


Then one ball is taken at random from the second urn and transferred 
to the third, and so on. Find the probability of drawing a white ball 
from the last urn. 

6.5 There are five guns that, when properly aimed and fired, have 
respective probabilities of hitting the target as follows: 0.5, 0.6, 0.7, 0.8 
and 0.9. One of the guns is chosen at random, aimed and fired. What 
is the probability that the target is hit? 

6.6 For quality control on a production line one item is chosen 
for inspection from each of three batches. What is the probability that 
faulty production will be detected if, in one of the batches, 2/3 of the 
items are faulty and in the other two they are all good? 

6.7 A vacuum tube may come from any one of three batches with 
probabilities p,;, p. and ps, where p; = ps = 0.25 and p, = 0.5. The 
probabilities that a vacuum tube will operate properly for a given 
number of hours are equal to 0.1, 0.2 and 0.4, respectively, for these 
batches. Find the probability that a randomly chosen vacuum tube will 
operate for the given number of hours. 

6.8 Player A plays two opponents alternately. The probability 
that he wins from one at the first trial is 0.5 and the probability that 
he wins from the other at the first trial is 0.6. These probabilities in- 
crease by 0.1 each time the opponents repeat the play against A. 
Assume that A wins the first two games. Find the probability that A will 
lose the third game if his opponent in the first game is not known and if 
ties are excluded. 

6.9 A particular material used in a production process may come 
from one of six mutually exclusive categories with probabilities 0.09, 
0.16, 0.25, 0.25, 0.16 and 0.09. The probabilities that an item of pro- 
duction will be acceptable if it is made from materials in these categories 
are, respectively, 0.2, 0.3, 0.4, 0.4, 0.3 and 0.2. Find the probability of 
producing an acceptable item. 

6.10 An insulating plate 100 mm. long covers two strips passing 
perpendicular to its length. Their boundaries are located, respectively, 
at the distances of 20, 40 mm. and 65, 90 mm. from the edge of the plate. 
A hole of 10 mm. diameter is made, so that its center is located equiprob- 
ably on the plate. Find the probability of an electric contact with any 
of the strips if a conductor is applied from above to an arbitrary point 
located at the same distance from the base of the plate as the center of 
the hole. 

6.11 The probability that k calls are received at a telephone 
station during an interval of time f is equal to P,(k). Assuming that the 
numbers of calls during two adjacent intervals are independent, find the 
probability P.,(s) that s calls will be received during an interval 2z. 

6.12 Find the probability that 100 light bulbs selected at random 
from a lot of 1000 will be nondefective if any number of defective 
bulbs from 0 to 5 per 1000 is equally probable. 

6.13 A white ball is dropped into a box containing 7 balls. What 
is the probability of drawing the white ball from this box if all the 
hypotheses about the initial color composition of the balls are equally 
probable? 


25 
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6.14 Ina box are 15 tennis balls, of which nine are new. For the 
first game three balls are selected at random and, after play, they are 
returned to the box. For the second game three balls are also selected 
at random. Find the probability that all the balls taken for the second 
game will be new. 

6.15 There are three quarters and four nickels in the right pocket 
of a coat, and six quarters and three nickels in the left pocket. Five 
coins taken at random from the right pocket are transferred to the left 
pocket. Find the probability of drawing a quarter at random from the 
left pocket after this transfer has been made. 

6.16 An examination is conducted as follows: Thirty different 
questions are entered in pairs on 15 cards. A student draws one card at 
random. If he correctly answers both questions on the drawn card, he 
passes. If he correctly answers only one question on the drawn card, 
he draws another card and the examiner specifies which of the two 
questions on the second card is to be answered. If the student correctly 
answers the specified question, he passes. In all other circumstances he 
fails. 

If the student knows the answers to 25 of the questions, what is the 
probability that he will pass the examination? 

6.17 Under what conditions does the following equality hold: 


P(A) = P(A | B) + P(A | B)? 


6.18 One of two urns, each containing 10 balls, has a marked ball. 
A player has the right to draw, successively, 20 balls from either of the 
urns, each time returning the ball drawn to the urn. How should one 
play the game if the probability that the marked ball is in the first urn 
is 2/3? Find this probability. 

6.19 Ten helicopters are assigned to search for a lost airplane; 
each of the helicopters can be used in one out of two possible regions 
where the airplane might be with the probabilities 0.8 and 0.2. How 
should one distribute the helicopters so that the probability of finding 
the airplane is the largest if each helicopter can find the lost plane within 
its region of search with the probability 0.2, and each helicopter searches 
independently? Determine the probability of finding the plane under 
optimal search conditions. 


7. COMPUTATION OF THE PROBABILITIES OF 
HYPOTHESES AFTER A TRIAL (BAYES’ FORMULA) 


Basic Formulas 


The probability P(H,, | A) of the hypothesis H,, after the event A occurred 

is given by the formula 
_ PCA,)P(A | Hy) 
PCH, | 4) = ~~ PA” 


where 
n 


P(A) = 2 P(H,)P(4 | H)), 


j=l 
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and the hypotheses H, (j = 1,..., ) form a complete set of mutually exclusive 
events. 


SOLUTION FOR TYPICAL EXAMPLES 


Example 7.1. A telegraphic communications system transmits the signals 
dot and dash. Assume that the statistical properties of the obstacles are such 
that an average of 2/5 of the dots and 1/3 of the dashes are changed. Suppose 
that the ratio between the transmitted dots and the transmitted dashes is 5:3. 
What is the probability that a received signal will be the same as the trans- 
mitted signal if (a) the received signal is a dot, (b) the received signal is a dash. 


SOLUTION. Let A be the event that a dot is received, and B that a dash 
is received. 

One can make two hypotheses: H, that the transmitted signal was a dot; 
and H, that the transmitted signal was a dash. By assumption, P(H,): P(H,) = 
5:3. Moreover, P(H,) + P(H,) = 1. Therefore P(H,) = 5/8, P(H.) = 3/8. One 
knows that 


P(A | Hi) = P(A | Hz) = 


3 


WIN Wie 


es 
5° 
2 
P(B| Hy) == — P(B| Hs) = 

The probabilities of A and B are determined from the total probability 
formula: 


es ee ae | 1 S22 SD 1 
Oa es ay 2 TS gs ago 
The required probabilities are: 
5.3 
_ P(Ay)P(A | i) _ 85 _ 3. 
(a) ct eee 7) ial lee 
2 
32 
_ P(H2)P(B| Hz) _ 83 _ 1 
(b) UG pay, 7 ae 2 
2 


Similarly one can solve Problems 7.1 to 7.16. 


Example 7.2 There are two lots of items; it is known that all the items 
of one lot satisfy the technical standards and 1/4 of the items of the other lot 
are defective. Suppose that an item from a lot selected at random turns out to 
be good. Find the probability that a second item of the same lot will be defective 
if the first item is returned to the lot after it has been checked. 


SOLUTION. Consider the hypotheses: H, that the lot with defective items 
was selected, and H, that the lot with nondefective items was selected. Let A 
denote the event that the first item is nondefective. By the assumption of the 
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problem P(H,) = P(H2) = 1/2, P(A | H,) = 3/4, P(A | 42) = 1. Thus, using 
the formula for the total probability, we find that the probability of the event A 
will be P(A) = 1/2[(3/4) + 1) = 7/8. After the first trial, the probability that 
the lot will contain defective items is 


1 3 
P(H,)P(A|Ai1) _ 24 3 


et atl 67) baa) 
8 


The probability that the lot will contain only good items is given by 
4 
P(H, | A) = =: 


Let B be the event that the item selected in the first trial turns out to be 
defective. The probability of this event can also be found from the formula for 
the total probability. If p; and pz are the probabilities of the hypotheses H, and 
H, after a trial, then according to the preceding computations p, = 3/7, 
Po = 4/7. Furthermore, P(B | H,) = 1/4, P(B| A.) = 0. Therefore the required 
probability is P(B) = (3/7)-(1/4) = 3/28. 

One can solve Problems 7.17 and 7.18 similarly. 


PROBLEMS 


7.1 Consider 10 urns, identical in appearance, of which nine con- 
tain two black and two white balls each and one contains five white and 
one black ball. An urn is picked at random and a ball drawn at random 
from it is white. What is the probability that the ball is drawn from the 
urn containing five white balls? 

7.2 Assume that k, urns contain m white and vn black balls each 
and that k, urns contain m white and n black balls each. A ball drawn 
from a randomly selected urn turns out to be white. What is the prob- 
ability that the given ball will be drawn from an urn of the first type? 

7.3. Assume that 96 per cent of total production satisfies the 
standard requirements. A simplified inspection scheme accepts a stand- 
ard production with the probability 0.98 and a nonstandard one with 
the probability 0.05. Find the probability that an item undergoing this 
simplified inspection will satisfy the standard requirements. 

7.4 From a lot containing five items one item is selected, which 
turns out to be defective. Any number of defective items is equally 
probable. What hypothesis about the number of defective items is most 
probable ? 

7.5 Find the probability that among 1000 light bulbs none are 
defective if all the bulbs of a randomly chosen sample of 100 bulbs turn 
out to be good. Assume that any number of defective light bulbs from 0 
to 5in a lot of 1000 bulbs is equally probable. 

7.6 Consider that D plays against an unknown adversary under 
the following conditions: the game cannot end in a tie; the first move 
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is made by the adversary; in case he loses, the next move is made by D 
whose gain means winning the game; if D loses, the game is repeated 
under the same conditions. Between two equally probable adversaries, 
Band C, B has the probability 0.4 of winning in the first move and 0.3 
in the second, C has the probability 0.8 of winning in the first move and 
0.6 in the second. D has the probability 0.3 of winning in the first move 
regardless of the adversary and, respectively, 0.5, 0.7 when playing 
against B and C in the second move. The game is won by D. 

What is the probability that (a) the adversary is B, (b) the adversary 
is C, 

7.7. Consider 18 marksmen, of whom five hit a target with the 
probability 0.8, seven with the probability 0.7, four with the probability 
0.6 and two with the probability 0.5. A randomly selected marksman 
fires a shot without hitting the target. To what group is it most probable 
that he belongs? 

7.8 The probabilities that three persons hit a target with a dart 
are equal to 4/5, 3/4 and 2/3. In a simultaneous throw by all three marks- 
men, there are exactly two hits. Find the probability that the third 
marksman will fail. 

7.9 Three hunters shoot simultaneously at a wild boar, which is 
killed by one bullet. Find the probability that the boar is killed by the 
first, second or the third hunter if the probabilities of their hitting the 
boar are, respectively, 0.2, 0.4 and 0.6. 

7.10 A dart thrown at random can hit with equal probability any 
point of a region S that consists of four parts representing 50 per 
cent, 30 per cent, 12 per cent and 8 per cent of the entire region. Which 
part of region S is most likely to be hit? 

7.11 In an urn, there are 7 balls whose colors are white or black 
with equal probabilities. One draws k balls from the urn, successively, 
with replacement. What is the probability that the urn contains only 
white balls if no black balls are drawn? 

7.12 The firstborn of a set of twins is a boy, what is the prob- 
ability that the other is also a boy if among twins the probabilities of two 
boys or two girls are a and 3, respectively, and among twins of different 

sexes the probabilities of being born first are equal for both sexes? 

7.13 Considering that the probability of the birth of twins of the 
same sex is twice that of twins of different sexes, that the probabilities 
of twins of different sexes are equal in any succession and that the 
probabilities of a boy and a girl are, respectively, 0.51 and 0.49, find the 
probability of a second boy if the firstborn is a boy. 

7.14 Two marksmen fire successively at a target. Their prob- 
abilities of hitting the target on the first shots are 0.4 and 0.5 and the 
probabilities of hitting the target in the next shots increase by 0.05 for 
each of them. What is the probability that the first shot was fired by the 
first marksman if the target is hit by the fifth shot? 

7.15 Consider three independent trials, in which the event A 
occurs with the probability 0.2. The probability of the occurrence of the 
event B depends on the number of occurrences of A. If the event A 
occurs once, this probability is 0.1; if A occurs twice, it is 0.3; if A 
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occurs three times it is 0.7; if the event A does not occur, the event B is 
impossible. Find the most probable number of occurrences of A if it is 
known that B has occurred. 

7.16 There are » students ina technical school. Of these, n,, where 
k = 1,2,3, are in their second year. Two students are randomly 
selected; one of them has been studying for more years than the other. 
What is the probability that this student has been studying for three 
years? 

7.17 The third item of one of three lots of items is of second 
grade, the remaining items are of first grade. An item selected from one 
of the lots turns out to be of first grade. Find the probability that it was 
taken from the lot containing second grade items. Find the same 
probability under the assumption that a second item selected from the 
same lot turns out to be of first grade if the first item is returned to the 
lot after inspection. 

7.18 Consider a lot of eight items of one sample. From the data 
obtained by checking one-half of the lot, three items turn out to be tech- 
nically good and one is defective. What is the probability that in checking 
three successive items one will turn out to be good and two defective if 
any number of defective items is equally probable in the given lot? 


8. EVALUATION OF PROBABILITIES OF OCCURRENCE OF 
AN EVENT IN REPEATED INDEPENDENT TRIALS 


Basic Formulas 


The probability P,.,, that an event occurs m times in » independent trials, 
in which the probability of occurrence of the event is p, is given by the binomial 
distribution formula 

Pas = Cop a, 
where gq = 1 — p. 

The probability for realization of the event at least m times in 7 trials 

can be computed from the formula 


1 m—-1 
Rasim = 2 Paivte or Ra:m =1- a Phas 
k=m k=0 
The probability of occurrence of the event at least once in n trials will be 
Rasa == q”. 


The number of trials that must be carried out in order to claim that a 
given event occurs at least once, with a probability at least P, is given by the 
formula 

In(l — P) 
pe pean ae aN 
es (1 — p) 
where p is the probability of occurrence of the event in each of the trials. 


The most probable value » of the number m of occurrences of the event A 
equals the integral part of the number (# + 1)p, and if (n + 1)p is an integer, 
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the largest value of the probability is attained for two numbers yp, = 
(n+ 1)p — 1 and po = (n + I)p. 

If the trials are independent, but the probabilities for realization of the 
event on different trials are different, the probability P,.,, that the event occurs 
m times in 7 trials equals the coefficient of u” in the expansion of the generating 
function 


G(u) = Uo (pu = qx) = 2, Piva. 


where q;, = 1 — p,, Pp, being the probability that the event occurs in the kth 
trial. 
The coefficients P,.,, can be determined by differentiating the function 


G(u): 
a! ow} 
Pam = m!\ du™ J, 





3 
=0 
which gives, for example, 


Piso = 4192°° *On- 


SOLUTION FOR TYPICAL EXAMPLES 


Example 8.1 What is more probable in playing against an equal adversary 
(if the game cannot end in a tie) to win (a) three games out of four or five 
out of eight, (b) at least three games out of four or at least five out of eight? 


SOLUTION. Since the adversaries are equal, the probabilities for them to 
win or lose a game are equal: ie., p = gq = 4 
(a) The probability of winning three pares out of four is 


] 1 
Pag = = Cisi 34 = 4 
The probability of winning five games out of eight is Py., = C3(1/28) = 
7/32. Since 1/4 > 7/32, it is more probable to win three games out of four. 
(b) The probability of winning at least three games out of four is 
1 5 


+o3=2) 


1 
Rag = Para + Pas = | 1 16 


and the probability of winning at least five games out of eight is 


7 8-7 ] 93 
Reis = Pers + Pare + Por + Pare = 35 + (“+8 + 1) 55 = 556° 
Since 93/256 > 5/16, it is more probable to win at least five games out of eight. 
Similarly one can solve Problems 8.1 to 8.31. 


Example 8.2 There are six consumers of electric current. The probability 
that under certain conditions a breakdown will occur that will disconnect one 
of the consumers is 0.6 for the first consumer, 0.2 for the second, and 0.3 for 
each of the remaining four. Find the probability that the generator will be 
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+ LAO, — FIGURE 7 


completely disconnected if (a) all the consumers are connected in series, (b) all 
the consumers are connected as shown in the scheme (Figure 7). 

SOLUTION. (a) The probability that all six consumers will not be dis- 
connected is equal to the product of the probabilities for each consumer not to 
be disconnected: that is, 

q = 919293 ~ 0.077. 


The required probability equals the probability that at least one consumer 
will be disconnected: that is, p = 1 — gq ~ 0.923. 

(b) In this case, the generator is completely disconnected if in each pair 
of successively connected consumers, there is at least one who is disconnected: 


p=(! — qiq2)(l — 93)? x 0.177. 
Problems 8.32 to 8.35 can be solved similarly. 


Example 8.3 A lot contains | per cent of defective items. What should be 
the number of items in a random sample so that the probability of finding at 
least one defective item in it is at least 0.95? 


SOLUTION. ‘The required number z is given by the formulan 2 In (1 — P)/ 
In(l — p). In the present case P = 0.95 and p = 0.01. Thus, n > In 0.05/ 
In 0.99 z 296. 

One can solve Problems 8.36 to 8.40 similarly. 


Example 8.4 A wholesaler furnishes products to 10 retail stores. Each of 
them can send an order for the next day with the probability 0.4, independent 
of the orders from the other stores. Find the most probable number of orders 
per day and the probability of this number of orders. 


SOLUTION. Here we have n = 10, p = 0.4, (x + 1)p = 4.4. The most 
probable number » of orders equals the integral part of the number (n + 1)p: 
that is, p» = 4. 

The probability of getting four orders out of 10 is 


Prog = Cio-0.4*-0.6% = 0.251. 


Similarly one can solve Problems 8.41 to 8.42. 


PROBLEMS 


8.1 Find the probability that the license number of the first car 
encountered on a given day will not contain (a) a 5, (b) two 5’s. 

All license numbers have four digits, repetitions of digits are per- 
mitted and all digits appear with equal probability in all positions. 


8. REPEATED INDEPENDENT TRIALS 33 


8.2 There are 10 children in a family. If the probabilities of a boy 
or a girl are both 0.5, find the probability that this family has (a) five 
boys, (b) at least three but at most eight boys. 

8.3 From a table of random numbers one copies at random 200 
two-digit numbers (from 00 to 99). Find the probability that among 
them, the number 33 appears (a) three times, (b) four times. 

8.4 Consider that a library has only books in mathematics and 
engineering. The probabilities that any reader will select a book in 
mathematics and engineering are, respectively, 0.7 and 0.3. Find the 
probability that five successive readers will take books only in engineer- 
ing or only in mathematics if each of them takes only one book. 

8.5 Two light bulbs are connected in series in a circuit. Find the 
probability that an increase in the voltage above its rated value will 
break the circuit if, under these assumptions, the probability that a bulb 
burns out is 0.4 for each of the two bulbs. 

8.6 The event B will occur only if the event A occurs at least three 
times. Find the probability for realization of the event B in (a) five 
independent trials, (b) seven independent trials, if the probability of 
occurrence of the event A in one trial is equal to 0.3. 

8.7 An electric system containing two stages of type A, one stage 
of type B and four stages of type C is connected as shown in Figure 8. 
Find the probability of a break in the circuit such that it cannot be 
eliminated with the aid of the key K if the elements of type A are out of 
order with the probability 0.3, the elements of type B with the prob- 
ability 0.4 and the elements of type C with the probability 0.2. 

8.8 The probability that a unit must undergo repairs after m acci- 
dents is given by the formula G(m) = 1 — (1 — 1/w)”, where a is the 
average number of accidents before the unit is submitted for repairs. 
Prove that the probability that after n cycles the unit will need repairs is 
given by the formula W, = 1 — (1 — p/w)", where p is the probability 
that an accident will occur during one cycle. 

8.9 Consider four independent trials in which the event A occurs 
with the probability 0.3. The event B will occur with the probability 1 if 
the event A occurs atJeast twice, it cannot occur if the event A does not 
occur, and it occurs with a probability 0.6 if the event A occurs 
once. Find the probability of the occurrence of the event B. 

8.10 Consider 200 independent shots fired at a target under 
identical conditions and leading to 116 hits. Which value, 1/2 or 2/3, for 
the probability of hitting in one shot is more probable if, before the 
trial, both hypotheses are equally probable? 
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8.11 Evaluate the dependence of at least one occurrence of the 
event A, in 10 independent trials, on the probability p for realization of 
the event A in each trial for the following values of p: 0.01, 0.05, 0.1, 
0.2, 0.3, 0.4, 0.5, 0.6. 

8.12 The probability that an event occurs at least once in four 
independent trials is equal to 0.59. What is the probability of occurrence 
of the event A in one trial if the probabilities are equal in all trials? 

8.13 The probability that an event occurs in each of 18 inde- 
pendent trials is 0.2. Find the probability that this event will occur at 
least three times? 

8.14 The probability of winning with one purchased lottery 
ticket is 0.02. Evaluate the probabilities of winning a prize with x tickets 
for n = 1, 10, 20, 30, 40, 50, 60, 70, 80, 90, 100 if the tickets belong to 
different series for each case. 

8.15 Given that a lottery ticket wins a prize and that the prob- 
abilities that this prize is a bicycle or a washing machine are, respec- 
tively, 0.03 and 0.02, find the probability of winning at least one of these 
items with 10 winning tickets selected from different series. 

8.16 A game consists of throwing rings on a peg. A player gets 
six rings and throws them until the first success. Find the probability 
that at least one ring remains unused if the probability of a successful 
throw is 0.1. 

8.17 Find the probability of scoring at least 28 points in three 
shots fired from a pistol at a target, with the maximal score of 10 points 
per shot, if the probability of scoring 30 points is 0.008. Assume that in 
one shot the probability of scoring eight points is 0.15, and less than 
eight points, 0.4. 

8.18 Two basketball players each make two attempts at throwing 
a ball into the basket. The probabilities of making a basket at each throw 
are, respectively, 0.6 and 0.7. Find the probability that (a) both will have 
the same numbers of baskets, (b) the first basketball player will have 
more baskets than the second. 

8.19 The probability that a tube will remain in good condition 
after 1000 hours of operation is 0.2. What is the probability that at 
least one out of three tubes will remain in good condition after 1000 
hours of operation? 

8.20 Three technicians produce items of excellent and good 
qualities on their machines. The first and second technicians make ex- 
cellent items with the probability 0.9 and the third technician with the 
probability 0.8. One of the technicians has manufactured eight items, of 
which two are good. What is the probability that among the next eight 
items made by this technician there will be two good and six excellent 
items? 

8.21 For victory in a volleyball competition, a team must win 
three games out of five; the teams are not equally matched. Find the 
probability that the first team will win each game if for equal chances 
this team must give odds of (a) two games, (b) one game. 

8.22 A competition between two chess players is conducted under 
the following conditions: draws do not count; the winner is the one who 
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first scores four points under the assumption that the adversary has in 
this case at most two points; if both players have three points each, 
the one who scores five points first wins. 

For each of the players, find the probability of winning the competi- 
tion if the probabilities of losing each game are in the ratio 3:2. 

8.23. A person uses two matchboxes for smoking. He reaches at 
random for one box or the other. After some time, he finds out that one 
box is empty. What is the probability that there will be k matches left in 
the second box if, initially, each box had n matches (Banach’s problem). 

8.24 The probability of scoring 10 points is 0.7, and nine points, 
0.3. Find the probability of scoring at least 29 points in three shots. 

8.25 During each experiment one of two batteries with powers of 
120 watts and 200 watts is connected in the circuit for one hour. The 
probabilities of a favorable outcome of this experiment are 0.06 and 0.08, 
respectively. One considers that the result of a series of experiments has 
been attained if one gets at least one favorable outcome in the experi- 
ment with the battery of 200 watts or at least two favorable outcomes 
with the battery of 120 watts. The total energy consumed in all experi- 
ments cannot exceed 1200 watts. Which battery is more efficient? 

8.26 A device stops if there are at least five defective tubes of 
type I and at least two defective tubes of type IT. Find the probability 
that the device will stop if five tubes are defective and if the probabilities 
of a defective tube among the tubes of type I and II are 0.7 and 0.3, 
respectively. 

8.27 The probability of a dangerous overload of a device is 0.4 
in each experiment. Find the probability that this device will stop in 
three independent experiments if the probabilities of a stop in one, two 
and three experiments are 0.2, 0.5 and 0.8. 

8.28 The probability that any of n identical units takes part in an 
experiment is p (p < 1/n). If a given unit participates in the experiments 
exactly k times, the result of these experiments is considered attained. 
Find the probability of attaining the desired result in m experiments. 

8.29 Under the assumptions of the preceding problem, find the 
probability of attaining the desired result in (2k — 1) experiments if 
the experiments are discontinued when the result has been attained. 

8.30 The probability that a device will stop in a trial is 0.2. How 
many devices should be tried so that the probability of at least three 
stops is 0.9? 

8.31 A point A must be connected with 10 telephone subscribers 
at a point B. Each subscriber keeps the line busy 12 minutes per hour. 
The calls from any two subscribers are independent. What is the minimal 
number of channels necessary so that all the subscribers will be served 
at any instant with the probability 0.99? 

8.32 Four radio signals are emitted successively. The probabilities 
of reception for each of them are independent of the reception of the 
other signals and equal, respectively, 0.1, 0.2, 0.3 and 0.4. Find the 
probability that & signals will be received, where k = 0, 1, 2, 3, 4. 

8.33 Using the assumptions of the preceding problem, find thc 
probability of establishing a two-part radio communication system if 
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the probability of this event is equal to 0.2 for the reception of one 
signal, 0.6 for two signals and | for three and four signals. 

8.34 The probabilities that three tubes burn out are respectively, 
0.1, 0.2 and 0.3. The probabilities that a device will stop if one, two or 
three tubes burn out are 0.25, 0.6 and 0.9, respectively. Find the prob- 
ability that the device will stop. 

8.35 A hunter fires a shot at an elk from a distance of 100 m. and 
hits it with the probability 0.5. If he does not hit it on the first shot, 
he fires a second shot from a distance of 150 m. If he does not hit the elk 
in this case, he fires the third shot from a distance of 200 m. If the 
probability of a hit is inversely proportional to the square of the dis- 
tance, find the probability of hitting the elk. 

8.36 How many numbers should be selected from a table of 
random numbers to ensure the maximal probability of appearance 
among them of three numbers ending with a 7? 

8.37. The probability of scoring 10 hits in one shot is p = 0.02. 
How many independent shots should be fired so that the probability of 
scoring 10 hits at least once is at least 0.9? 

8.38 During one cycle an automatic machine makes 10 items. 
How many cycles are necessary so that the probability of making at 
least one defective item is at least 0.8 if the probability that a part is 
defective is 0.01? 

8.39 Circles of radius | cm. have their centers located 60 cm. apart 
on a line. Several lines of this kind are placed parallel to each other in 
the same plane; a relative shift of the lines with any amount from 0 to 
60 cm. is equally probable. A circle of radius 7 cm. moves in the same 
plane and perpendicularly to these lines. What should be the number 
of lines so that the probability of intersection of the moving circle with 
one of the other circles is at least 0.9? 

8.40 From a box containing 20 white and two black balls, » balls 
are drawn, with replacement one at a time. Find the minimal number 
of draws so that the probability of getting a black ball at least once 
exceeds 1/2. 

8.41 For a certain basketball player the probability of throwing 
the ball into the basket in one throw is 0.4. He makes 10 throws. Find 
the most probable number of successful throws and the corresponding 
probability. 

8.42 Find the most probable number of negative and positive 
errors and the corresponding probabilities in four measurements if, in 
each of them, the probability of a positive error equals 2/3, and of a 
negative one, 1/3. 


9, THE MULTINOMIAL DISTRIBUTION. RECURSION 
FORMULAS. GENERATING FUNCTIONS 
Basic Formulas 


The probability that in z independent trials, in which the events A;, Ao, .. 
A, occur with the corresponding probabilities p,, po,..-, Pm, the events Ay, 
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where k = 1, 2,..., m, will occur exactly n times (O%_, , = n), is given by the 
multinomial distribution formula: 


n! 


Pr, = —— pip. --ptr 
NIN NZ,--5Nm mi! Mg!---n,l? is Pm 


nm 18 the coefficient of utiug2---urm in the follow- 


Zrrees 


ing generating function: 
G(Uy, Ua, . ++) Um) = (Pity + Pola +--+ + Pmllm)”. 


The generating function for n + N independent trials is the product of the 
generating functions for m and N trials, respectively. Using this property, one 
can frequently simplify the calculation of the required probabilities. For the 
same purpose one applies a proper substitution of the arguments in the generat- 
ing function. If, for instance, one wishes to find the probability that in x trials 
the event A, will appear / times more than the event Aj, then in the generating 
function one should set u, = 1/u, u, = u, u; = 1, where j = 3,4,...,m. The 
required probability is the coefficient of u’ in the expansion in a power Series 
for the function 


G(u) = (ru +2 se > r,) : 
7=3 


If p, = 1/m, where k = 1,2,...,m, and one wishes to find the probability 
that the sum of the numbers of the occurring events is r, one looks for the 
coefficient of u’ in the expansion in powers of u of the function 

u” 


Gu) = Saul tute tum = (Fa ) 





In the expansion of G(u), it is convenient to use for (1 — u)~” the following 
expansion: 
(l— w)-*= 14+ Ch-tu + Ciyiw® + Cha +--. 


Factorials of large numbers can be obtained from logarithm tables (see 2T 
in the table list) or approximated by Stirling’s formula: 


— 1 it 
f= Np~t ee eS ger a 
nt= V2nnn e (1 + 12 WB8n2 


The probability of occurrence of a given event can sometimes be obtained using 
relations (recursion formulas) of the form 


Pe = APy-1 + OxPe-25 


where a, and b, are given constants. The required probability is determined by 
passage from n to n + 1, after an evaluation, based on initial data, of the 
probabilities for several] values of k. 


SOLUTION FOR TYPICAL EXAMPLES 


Example 9.1. The probabilities that the diameter of any item is less than, 
greater than or equal to some accepted value are respectively 0.05, 0.10 and 
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0.85. From the total lot, one selects 100 random samples. Find the probability 
that among them there will be five items with a smaller diameter and five with a 
larger diameter than the acceptable diameter. 


SOLUTION. Let the event A, mean that an item of the first type, an item 
Az of the second type and Az of the third type are randomly selected. By assump- 
tion, Pp; = 0.05, pg = 0.10, ps = 0.85. The total number of trials, n, is 100. We 
seek the probability p that the events A, and A, will occur five times each. 
Then 1, = ng = 5, n3 = 90. Therefore the required probability 


= P — 100! _ 9 955.9.15.0,959° 
P = £100:5,5,90 = 515100!” : . ; 


If we use logarithms, we find 
log p = log 100! — log 90! — 2 log 5! + Slog 5 + 90 log 0.85 — 15. 


Using the logarithm table for factorials and the table for decimal logarithms, 
we obtain 


log p = 3.7824, or p x= 0.006. 
Similarly one can solve Problems 9.1 to 9.7 and 9.25. 


Example 9.2 In each trial the probability of occurrence of an event equals 
p. What is the probability that the number of occurrences of the event will be 
even in # trials? 


SOLUTION. Let us denote by p,, the probability that in & trials the event 
will occur an even number of times. 

Before the Ath trial, one can make two hypotheses: in the (A — 1)st trial, 
the event occurred an even or odd number of times. The probabilities of these 
hypotheses are p,_, and | — p,_,, respectively. Then 


Pe = Pe-1 — p) + — Dei); 
that is, 


Pu = P+ Py-i(l — 2p). 
Representing the last expression in the form 


(> 2 5) adi xs 2p)( Pes = 5) ag ene 


and, respectively, multiplying the left and right sides of m such equalities, we 
obtain 


TI (pe - 3) = - 2 TI (2-1 - 5): 


k=1 k=1 


: Suis . , 1 
Simplifying both sides of the last equality by (>. — 5}, we find 


n-1 
Fy 
k=1 
1 “ 1 
Pn — 5 = (1 — 2p) (po - 5): 
Since py = 1, the required probability will be 
1 
Pa = 5 ll + (1 — 2)". 


Problems 9.8 to 9.13 and 9.26 can be solved similarly. 
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Example 9.3 Find the probability of purchasing a ticket with a number 
whose sums of the first three and last three digits are equal if it has six digits 
and may be any number from 000000 to 999999, 


SOLUTION. Let us first consider the first three digits of the number. Since 
they are arbitrary, one can consider that one performs three trials (n = 3), in 
which any one digit occurs with the probability p = 1/10. 

In the given case, the number of events, m, is 10, the probability is p = 1/10, 
where k = 0,1,..., 9, and the generating function has the form 


1 /< : 
G,(Uo, W1,..., Us) = Tos (> 4) ’ 
k=0 


where the subscript k of u, indicates the number k occurring in the trial. 
Let us set u, = u*. Then the coefficient of uv’ in the expansion of the 


function 
1/2 .\'_ 1 fl- ws 
6.0) = 7 (> «4 =e (=) 


gives the probability that the sum of the first three digits of the number on the 
ticket is o. 
Similarly, the coefficient of u~° in the expansion of 


1 {1 —u-1%3 
GW) = 7 (=) 
gives the probability that the sum of the last three digits of the number is o. 
But in this case, the coefficient of u° in the expansion 


G(u) = G,(u)G,(u) = aaa (4) 


is equal to the required probability that the sum of the first three digits and the 
sum of the last three digits are equal. 
We have 
(1 — u?°)® = 1 — Cul? + C2u?° —..., 


(l—u)& =1+4 Ciu+ Cv? +---. 
Thus the required probability is 


Similarly one can solve Problems 9.14 to 9.24. 


PROBLEMS 


9.1 Suppose that an urn contains three balls: one black, one red 
and one white. One draws balls from it five times, one ball at a time, 
with replacement. Find the probability that the red and white balls will 
be drawn at least twice each. 
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9.2 An employee produces a good item with probability 0.90, an 
item with a defect that can be eliminated with the probability 0.09 and 
an item with a permanent defect with the probability 0.01. He makes 
three items. Find the probability that among them there is at least one 
good item and at least one with a defect that can be eliminated. 

9.3 Each of nine balls can be placed with equal probability in one 
of three initially empty boxes. Find the probability that (a) there will be 
three balls in each box, (b) there will be four balls in the first box, three 
in the second box and two in the third box. 

9.4 Ten shots are fired at a target consisting of an inner circle and 
two concentric annuli. The probabilities of hitting these regions in one 
shot are 0.15, 0.22 and 0.13, respectively. Find the probability that there 
will be six hits in the circle, three in the first annulus and one in the 
second annulus. 

9.5 A device consists of four units, each made of vacuum tubes. 
If one tube is out of order, the probabilities that it belongs to a given 
unit are p; = 0.6111, pp = ps = 0.664, p, = 0.2561, respectively, and 
these do not depend on how many tubes were previously out of order. 
Find the probability that the device will stop when four tubes are out of 
order if this event may occur when at least one tube of the first unit or 
at least one tube in each of the second and third units is out of order. 

9.6 Twelve persons get on a train that has six cars; each passenger 
may select with equal probability each of the cars. Find the probability 
that (a) there will be two passengers in each car, (b) there will be one car 
without passengers, one with one passenger, two with two passengers 
each and the remaining two with three and four passengers, respectively. 

9.7 An urn contains / white, m black and n red balls. From it are 
drawn, with replacement, one at a time, /, + m, + n, balls. Find the 
probability that (a) first, /; white balls, then m, black balls, and finally, 
n, red balls are drawn, (b) /; white, ™, black, and n, red balls are drawn 
so that balls of identical color appear successively, but the succession of 
colors may be arbitrary, (c) /; white, m, black and », red balls are drawn 
in any succession. 

9.8 Find the probability that in n tosses, a coin will show heads 
an odd number of times. 

9.9 Two equally matched adversaries play chess until one of them 
leads by two games. What is the probability that 2” decisive games (that 
are not draws) will be needed ? 

9.10 Two persons play until one of them wins all the money from 
the other. Find the probability that exactly n games will be necessary if 
all the stakes are equal, each player has at the beginning three stakes, 
and the probability of winning a game is 1/2 for each of the two players. 

9.11 Two persons play until one of them is ruined. The first player 
has an initial capital of m dollars and the second, m dollars. The prob- 
abilities of winning are, respectively, p andg(p + g = 1). Ineach game, 
the gain for one player (loss for the other) is one dollar. Find the 
probabilities of a complete ruin for each of them. 

9.12 JInachess competition there aren + 1| equally good players. 
Each man plays each of the others until he loses. The competition con- 
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tinues until one of the players wins ” games. What is the probability 
that m decisive games will be played (draws are not counted)? 

9.13 A competition between two equal chess players takes place 
under the following conditions: the draws are not taken into account; 
the winner is the one who scores six points if his adversary scores no 
more than four points; if one wins six games, and the other five, then 
the competition continues until the difference in points becomes two. 

Find the probability that the number of decisive games is (a) at 
most 10, (b) exactly x. 

9.14 The probability that an event occurs in each of n experiments 
is equal to p. Prove that the generating function for the probabilities of 
at least n — m occurrences of this event is 


G6i= tw 


9.15 The probability that an event occurs in the Ath experiment 
is equal to p, (kK = 1, 2,..., ). Prove that the generating functions for 
the probabilities of, respectively, at most m occurrences and at least 
n — m occurrences of this event, in 7 independent trials are 

nh 
: (9% + Px) 


; TI (x + gett) 
G,(u) = © = Wide 8 


and G,(u) = er 


9.16 Each of two marksmen fires 1 shots at his target. Find the 
probability that they will score the same number of hits if the prob- 
ability of hitting in each shot is 0.5. 

9.17 Each of two identical devices, left and right, has two tubes. 
After 100 hours of operation, one tube can burn out in only one of them 
with the probability 1/4 and both tubes can burn out with the probability 
1/16. Find the probability that in » pairs of such devices the number of 
burnt-out tubes in the left devices will exceed at least by m (m < 2n) 
the number of burnt-out tubes in the right devices. Find this probability 
in the case when nv = m = 3. 

9.18 The competition for the title of world champion in 100 
square-board checkers consists of 20 games. Find the probability that 
it will end with the score 12:8 if the probability of winning each game is 
0.2 for each of the two players. 

9.19 To win the competition for the title of world champion in 
chess, the challenger must score at least 12.5 points out of a possible 24, 
In the case of a tic (12:12) the title is kept by the defending champion. 
The participants are two equal players whose probabilities of winning a 
game are half as great as the probabilities of a tie. Find (a) the proba- 
bility that the defending champion will keep his title, and the proba- 
bility that the challenger will become the world champion, (b) the 
probability that 20 games will be played in this competition. 

9.20 Find the probability that in n throws of a pair of dice, the 
sum of points marked on the upper faces will be (a) equal to a given 
number m, (b) not greater than m. 

Find these probabilities for 2 = 10 and m = 20. 


4] 
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9.21 Find the probability of getting a ticket with a number the sum 
of whose digits is 21 if all numbers of the ticket from 0 to 999999 are 
equally probable. 

9.22 Any of the quantities X¥,, X2,..., X, can take any integral 
positive value from 1 to m with equal probability. Find the probability 
that the sum X, + X, +---+ X, will be (a) equal to a given number 
N (nm > N > an), (b) not less than a given number N. 

9.23 Two marksmen fire three shots each at their targets. One can 
score any number of points from seven to 10 with equal probability, 
whereas for the other, the probability of scoring seven and 10 points is 
1/8, and of scoring eight and nine points is 3/8. Find the probability 
that (a) the first marksman will score 25 points, (b) the second marksman 
will score 25 points, (c) both marksmen will score the same number of 
points. 

9.24 Two distinguishable coins are tossed simultaneously and re- 
peatedly. Find the probability that at the mth toss (and not before) each 
will have shown heads as many times as the other. 

9.25 Find the probability that a runoff will be necessary in the 
elections of / persons if people vote. The probability of being eliminated 
is the same for each of the & candidates and equal to p, and to be elected 
a candidate must get the majority of the votes. A runoff takes place only 
in the case when candidates / and / + 1 get an equal number of votes. 

9.26 Two equal volleyball teams play one game. The game con- 
tinues until one of the teams leads by two points; the minimal score 
necessary is 15. Find the probabilities (a) P,, and Q,, that the game will 
be won, respectively, by the first team (which serves the ball first) and the 
second team with the score 15:k (k = 0, 1,...,13), (b) P, and Q, that 
the game will be won by each of the teams if the losing team has at most 
13 points, (c) P, and Q, that the game will be won with a score of 
(16 + k):(14 + k), where k = 0,1,..., (d) Py and Q,, that the game 
will be won if each team loses at least 14 points, (e) P and Q that the 
game will be won, respectively, by the first and second teams. 
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10. THE PROBABILITY DISTRIBUTION SERIES, THE 
DISTRIBUTION POLYGON AND THE DISTRIBUTION 
FUNCTION OF A DISCRETE RANDOM VARIABLE 


Basic Formulas 


A random variable is said to be discrete if its possible values can be 
enumerated. 

A discrete random variable X can be specified by: (1) a distribution series, 
(2) a distribution function (integral distribution law). 

By a distribution series we mean the set of all possible values x, of X, and 
the corresponding probabilities p, = P(X¥ = x,). A distribution series can be 
represented by a table (see Table 2) or a formula. 

The probabilities p; satisfy the condition 


in which the value of n may be finite or infinite. 

The graphic representation of a distribution series is called a distribution 
polygon. To construct it, one represents the values of the random variable (x;) 
on the x-axis, and the probabilities p, on the y-axis; next, one joins the points A; 
with the coordinates (x,, p,) by a broken curve (Figure 9). 

The distribution function (integral distribution law) of a random variable 
X is defined as the function F(x), equal to the probability P(X < x) that the 
random variable is less than the (arbitrarily chosen) value x. The function F(x) 
is given by the formula 


F(x) a > Pi, 
KES 


in which the summation is extended over all values of i such that x; < x. 


TABLE 2 
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FIGURE 9 





SOLUTION FOR TYPICAL EXAMPLES 


Example 10.1 From a lot of 100 items, of which 10 are defective, a random 
sample of size 5 is selected for quality control. Construct the distribution series 
of the random number X of defective items contained in the sample. 


SOLUTION. Since the number of defective items in the sample can be any 
positive integer from 0 to 5 inclusive, the possible values x; of the random 
variable X are 


x, = 0, X_ = 1, X=. 2; i= 3; x, = 4, Xe = 5. 

The probability PLY = k) that the sample will contain exactly k (k = 0, 1, 
2, 3, 4, 5) defective items 1s 
CToC3o* 

Cio0 

The computations with the preceding formula give, with an accuracy of 

0.001, the following results: 
Dy = P(X = 0) = 0.583, spp = P(X = 1) = 0.340, 
ps = P(X = 2) = 0.070, 
Ds = P(X = 3) = 0.007, Ds = P(X = 4) = 0, 
pe = P(X = 5) =0. 


Using for verification the equality >8_, p, = 1, we can convince ourselves that 
the computations and the round-off are correct (see Table 3). 


P(X =k) = 


TABLE 3 





0.340 0.070 0.007 





Similarly one can solve Problems 10.13 and 10.14. 


' Example 10.2 Items are tested under overload conditions. The probability 
that each item passes the test 1s 4/5 and independence prevails. The tests are con- 
cluded when an item fails to meet the requirements of the test. Derive the formula 
for the distribution series of the number of trials. 
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SOLUTION. The trials end with the kth item (kK = 1, 2, 3,...) if the first 
k — | items pass the test and the kth item fails. 
If X is the random number of trials, then 


Nate 7 ae 
P(X = k) = (1 - 3) 3 =3(5) < (Sis: 


The formula obtained for the distribution series is equivalent to Table 4. 


TABLE 4 





3 





The peculiarity of the current problem is that theoretically the number of 
trials can be infinite, but the probability of such an event is zero: 


= 0. 





a P ee aa 
Ege oe eer oe 

Problems 10.2, 10.4, 10.5, 10.7, 10.10 and 10.12 are solved in a similar 
manner. 


Example 10.3. A car has four traffic lights on its route. Each of them 
allows it to move ahead or stop with the probability 0.5. 

Sketch the distribution polygon of the probabilities of the numbers of 
lights passed by the car before the first stop has occurred. 


SOLUTION. Let X denote the random number of lights passed by the car 
before the first stop occurs; it can assume the following values: 


x, = 0, Xo = 1, Xz = 2, ie Ko a. 


The probabilities p, = P(X = x,) that the number of traffic lights X passed 
by the car will equal some given value can be computed with the formula 


pil — py? for i= 1, 2, 3,4, 
(1 — p)* for: = 5, 


in which p is the probability with which the traffic lights can stop the car 
(p = 0.5). 

As a result of these computations, we obtain that p, = 0.5, pz = 0.25, 
P3 = 0.125, ps = 0.0625, p; = 0.0625. With these results we construct the 
probability distribution polygon (Figure 10). 

Following this example, we can solve Problems 10.3, 10.8 and 10.9. 


ppo=P(X¥ =x) = 


Example 10.4 A space rocket has a device consisting of four units A,, As, 
Ag, Aq, each of which fails to operate when at least one elementary particle hits it. 
The failure of the entire device occurs either if A, fails or if Az, Az; and A, fail 
simultaneously. 


46 RANDOM VARIABLES 


FIGURE 10 
Zi 


Construct the distribution function F(x) of the random number of elementary 
particles X, for which the entire device will fail if the probability that a particle 
reaching the device will hit A, is p; = 0.4, and the probabilities for hitting A, 
Ag and Ag, are, respectively, pp = p3 = p, = 0.2. 


SOLUTION. Let A,, Ao, As, A, denote the events that Aj, Az, Az, Ag fail. 
The required distribution function F(x) equals the probability that the device 
will continue its operation after n < x hits; 1.e., 


F(x) = P(A, U A2A3 Aq). 
Using the formula (see Section 5) 
A, U ApAgAq = Ay(Ap U Ag U Ay) = A, An U A, As U AAs 
= (Ay U Az) + (A, U Ag) + (Al U Ay) 
and applying the formula for the addition of probabilities, we obtain 
F(x) = 1 — P[(A, U Aq) U (A, U Ag) U (A, U AY)] 
= ] — P(A, U A.) — P(A, U Az) — P(A; U Ag) 
+ P{(A, U As\(A, UA,)] + PICA, U ALA; U AQ) 
+ P[(A; U A3)(Ai U Ag)] — P[(Ay U A2)(Ai U Ag)(Ai U AQ), 


where all the probabilities are defined under the assumption that n particles hit 
the device. Since p; + Po + p3 + pa = 1, and for each hit of a particle one and 
only one stage necessarily fails to operate, we have 


P(A, U Az) = (py + Pa)®; P(A. U Ag) = (Po + Pa)” 
P(A, U Ag) = (Po + Pa)”; 
P[(A; U A2)(A; U Asz)] = 795 P[(A, U Ag)(A1 U Ay) = DS 
P[(A, U A3)(Ai U Aa) = 3; 
P((A, U A,)(Ai + As)(Ai VU AQ)] = 9. 
Thus, taking into account that p. = ps = p, = 0.2, we obtain 
QI] _ [2 


where [x] denotes the largest integer less than x, for example, [5.9] = 5, [5] = 4. 
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FIGURE 11 


Therefore, the graph of the probability distribution function for several 
initial values of x has the form shown in Figure 11. 
Problems 10.6 and 10.11 are solved similarly. 


PROBLEMS 


10.1 Construct the distribution series and the distribution function 
for a random number of successful events in one experiment if the ex- 
periment consists of throwing a ball into a basket and the probability of 
a success in one trial is p = 0.3. 

10.2. An experiment consists of three independent tossings of a 
coin, in each of which heads shows up with the probability p = 0.5. 
For a random number of heads, construct (a) its distribution series, 
(b) distribution polygon, (c) distribution function. 

10.3. Five devices are subjected to successive reliability tests. Each 
device is tested only if the preceding one turns out to be reliable. 

Construct the distribution series of a random number of tests if the 
probability of passing these tests is 0.9 for each device. 

10.4 Some independent experiments are discontinued when the first 
favorable outcome has occurred. For a random number of experiments 
find (a) the distribution series, (b) the distribution polygon, (c) the most 
probable number of experiments, if the probability of a favorable 
outcome in each trial is 0.5. 

10.5. Two basketball players shoot the ball alternately until one 
of them scores. Construct the distribution series for a random number 
of shots thrown by each of them if the probability of a success is 0.4 for 
the first player and 0.6 for the second. 

10.6 A target consists of a circle numbered | and two annuli 
numbered 2 and 3. By hitting the circle numbered 1, one scores 10 
points; the annulus numbered 2, 5 points; and the annulus numbered 3, 
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1 point. The corresponding probabilities of hitting the circle numbered 1 
and annuli numbered 2 and 3, are 0.5, 0.3 and 0.2. Construct the distri- 
bution series for a random sum of scores as a result of three hits. 

10.7 An experiment is performed with a series of identical devices 
that are turned on successively for a period of five seconds each. The 
lifetime of one device is 16 seconds. The experiment is discontinued 
when at least one device stops. Find the distribution series for a random 
number of devices if the probability of stopping is 1/2 for each device. 

10.8 There are » patterns for the same item. The probability of 
producing a nondefective item from each of them is p. (a) Find the 
distribution series of the number of patterns left after the first non- 
defective item has been produced. (b) Construct the distribution series 
for a random number of patterns used. 

10.9 A lot of n items is tested for reliability; the probability that 
each item passes the test is p. Construct the distribution series for a 
random number of items that pass the test. 

10.10 A device consisting of units a, b, and 6, fails to operate if 
the event C = A U B,B,, where A denotes the failure of the unit a, and 
B, and B, denote failure of the units 6, and b., respectively. The failures 
occur when the device is hit by at least one cosmic particle. Construct the 
distribution series of a number of random particles hitting the device if 
the probabilities that a particle hits one of the units are: P(A) = 0.5, 
P(B,) = P(B,) = 0.25. 

10.11 An experiment can be a success with probability p or a 
failure with probability (1 — p). The probability of a favorable outcome 
in m successful trials is Pm) = 1 — (1 — 1/w)". Construct the distribu- 
tion series of the number of trials necessary for a favorable result. 

10.12 The number of trials X is a random integer between 0 and 
co. The probability P(X = k) = (n*e~")/k!. Each trial can be a success 
with the probability p and a failure with the probability (1 — p). 
Construct the distribution series of the number of successful trials. 

10.13. The probability of obtaining heads in each of five tosses of a 
coin is 0.5. Find the distribution series for the ratio of the number X of 
heads to the number Y of tails. 

10.14 Construct the distribution series for the sum of digits of 
three-digit random numbers. 


11. THE DISTRIBUTION FUNCTION AND THE PROBABILITY 
DENSITY FUNCTION OF A CONTINUOUS RANDOM 
VARIABLE 


Basic Formulas 


A random variable is said to be continuous if it can assume any numerical 
values on a given interval, and for which, for any x on this interval, there 


exists the limit 
— ye P(x < X¥ < x + Ax) 
LO pee ye ee 


called probability density. 
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A continuous random variable can be defined either by a distribution func- 
tion F(x) (the integral distribution law) or by a probability density function 
f(x) (differential distribution law). 

The distribution function F(x) = P(X < x), where x is an arbitrary real 
number, gives the probability that a random variable X will be less than x. 

The distribution function F(x) has the following basic properties: 

(1) Pa<X < db) =F(b) — F@); 

(2) F(x) < F(%2), if x1 < X23 

(3) lim F(x).= I; 

(4) lim F(x) = 0. 


The probability density function (differential distribution law) f(x) has the 
following fundamental properties: 


() f(x) 2 
(2) f(x) = 


(3) (eae 1; 


@) Pa<x<b)=[ fede. 


The quantity x, defined by the equality F(x,) = p is called a quantile; the 
quantile xo,, is called the median. If the density has a maximum, the value of x 
for which f(x) = max is called the mode. 

The notion of probability density f(x) can also be introduced for a discrete 
random variable by setting 


I(x) = > Pr&x — x), 


in which x, denote the possible values of the random variable, p, are their 
corresponding probabilities 


oe a 


Pe = P(X = x;), 
5(x) is the 5-function, that is, a ““generalized”’ function with the properties 


o, x=0, 
x) = {f x £0, 


| © 8) dx = 1, ie e(x)8(y — x) dx = 9), 


where (x) is any function continuous at the point x = y. The function 8(x) 
can be represented analytically by 


&(x) = = | e'?* dus, 
rn ae 
where the integral is understood in the sense of its principal value.* 


1 See for example, Gelfand, I. M., and Shilov, G. E.: Generalized Functions. Vol. 1, 
Properties and Operations. Translated by E. Saletan. New York, Academic Press, Inc., 
1964. 
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SOLUTION FOR TYPICAL EXAMPLES 
Example 11.1 The projection X of the radius-vector of a random point on 


a circumference of radius a onto the diameter has the distribution function (the 
arcsine law) 


] x 2G; 
1 ] eS 
F(x) =<a + -aresin-= for <—-a<x <a; 
2° oF a 
0 x S-a. 


Determine (a) the probability that X will be on the interval (—a/2, a/2), 
(b) the quantile x9.75, (c) the probability density f(x) of the random variable X, 
(d) the mode and median of the distribution. 


SOLUTION. (a) The probability that XY assumes values on the interval 
(—a/2, a/2) is equal to 


a a a a 2 . 1 l 
P(-S <X< 5) = F(5) —= F(-5) eos = 3" 


(b) By assumption p = 0.75; solving the equation 





: + ee POSTS 2075) 
2 #@ a 


we obtain 
avi 


Xo.75 = 5) 





(c) The probability density f(x) of the random variable X is: 


(1) for all values of x belonging to the interval (—a, a), 


cs aa ee mene: a a 
S(x) = ay = 5 (5 + zaresing) = 





(2) zero for all the remaining values of x. 


(d) We call the value of the argument for which the probability density 
achieves its maximum the distribution mode. The arcsine law has no mode 
since the function 

1 
A ae 
has no maxima. 

We call the quantity x,.5 the distribution median defined by the equality 
F(Xo.5) = 1/2. 

Solving the equation 


4 


Nl 


we find that x)., = 0. 
Problems 11.1 to 11.8 are solved similarly. 
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Example 11.2 The probability density of a random variable is 
f(x) = axPe"™*  — (k > 0,0 < x <@). 


Find (a) the coefficient a, (b) the distribution function of the random 
variable X, (c) the probability that the random variable belongs to the interval 


(0, 1/k). 
SOLUTION. (a) The coefficient a is given by the equality 
i ax’e"** dx = 1. 


0) 
This implies that 


= Kot. 
| x%e—** dx 
0 


Consequently, a = k3/2 and the probability density has the form 
3 
{[@= Exe, 
(b) The distribution function F(x) of the random variable X is determined 


by the formula 
k*x2 + 2kx +2 _,, 
5 ee 


(c) The probability P(O < X < 1/k) that the random variable X will assume 
values on the given interval is computed according to the formula 


x 3 
F(x) = | “x xe dx = 
0 


k k 2e 


Similarly one can solve Problems 11.9, 11.10 and 11.12. 


P(0< x <7) = F(z) =1- Fv 0.086. 


Example 11.3. An electronic device has three parallel lines. The probability 
that each line fails to operate during the warranty period of the device is 0.1. 
Using the 5-function, express the probability density for a random number of 
lines that fail to operate during the warranty period if the failure of one line 
is independent of whether the other lines operate. 


SOLUTION. Let us denote by X the random numbers of lines that fail. The 
random variable YX is discrete, and its distribution series (Table 5) is 


TABLE 5 





0.243 0.027 
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Using the notion of probability density for a discrete variable, we obtain 
F(x) = 0.7298(x) + 0.2436(% — 1) + 0.0275(x — 2) + 0.001 8(x — 3). 


Similarly we can solve Problem 11.15. 


PROBLEMS 


11.1 The distribution function of a uniformly distributed random 
variable X has the form 


0 for x < 0, 
F(x) =<x forO<x <1, 
1 for x > 1. 


Find the probability density of the random variable YX. 
11.2 Given the distribution function of a random variable 


x 2 
F(x) = = | exp {-5} dt (normal distribution law), 


—-@ 


find the probability density of the random variable X. 
11.3 Cramer (1946) gives the distribution function of the yearly 
incomes of persons who must pay income tax: 
he (= 
F(x) = x 


0 for x < Xo 


i) for ¥ x. (a > 0) 
a ‘ 


Find the yearly income that can be exceeded by a randomly selected 
taxpayer with the probability 0.5. 

11.4 The distribution function of the random period during which 
a radio device operates without failures has the form 


jt ee exp { -7} (t > 0). 


Find (a) the probability that the device will operate without failures 
during a time period 7, (b) the probability density f(r). 

11.5 The random variable representing the eccentricity of an item 
is characterized by the Rayleigh distribution 


F(x) = 1 — exp { - 35} (x > 0). 


Find (a) the mode of the distribution, (b) the median of the distri- 
bution, (c) the probability density f(x). 
11.6 The Weibull distribution function 
x™ 


F(x) =1- exp {-=} (x > 0) 


characterizes in a series of cases the lifetime of the elements of an 
electronic instrument. 
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Find (a) the probability density f(x), (b) the quantile of order p of 
this distribution, (c) the mode of the distribution. 

11.7. The random nonoperating period of a radio device has the 
probability density 





_ M (log x — log xo)? 
DO ia e 20 } 


where M = loge = 0.4343... (this is the logarithmic normal distri- 
bution law). 

Find (a) the mode of the distribution for x» = 1 and o = V5M, 
(b) the distribution function. 

11.8 Given the distribution function of a random variable X: 
F(x) = a + barctan (x/2) (—o < x < +00) (the Cauchy probability 
law), determine (a) constants a and 5b, (b) the probability density, 
(cy) P(a < X¥ < 8B). 

11.9 How large should a be so that f(x) = ae~*’ is the probability 
density of a random variable X varying between infinite bounds? 

11.10 For which value of a is the function 





IO) =F rae (—co < x < +00) 
equal to the probability density of a random variable X ? 

Find (a) the distribution function of the random variable X, (b) the 
probability that the random variable will fall in the interval (—1, 1). 

11.11 The scale of a stop watch has divisions of 0.2 seconds each. 
What is the probability that the error in the time estimate is larger than 
0.05 seconds if the estimate is made with an accuracy of one division with 
a round-off to the nearest integer. 

11.12 The azimuthal limb has divisions of 1° each. What is the 
probability that there will occur an error of +10’ in the computation of 
the azimuth if the angle estimates are rounded off to the nearest degree? 

11.13 It is known that the probability of failure for an electronic 
tube during Ax days is kAx with a precision of higher order of magnitude 
than Ax, and is independent of the number x of days during which the 
tube operates prior to the interval Ax. What is the probability of failure 
for a tube during / days? 

11.14 A streetcar line has a length L. The probability that a 
passenger will get on the streetcar in the vicinity of a point x is pro- 
portional to x(L — x)’, and the probability that a passenger who entered 
at point x will get off at point y is proportional to (y — x)", h > 0. 

Find the probability that (a) the passenger will get on the streetcar 
before point z, (b) the passenger who got on the streetcar at point x will 
get off after point z. 

11.15 Some devices are subjected to successive accelerated re- 
liability tests that are terminated when the first failure occurs. Using the 
concept of probability density of a discrete random variable, find the 
probability density of a random number of devices tested if the proba- 
bility of failure for each device is 0.5. 
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12, NUMERICAL CHARACTERISTICS OF DISCRETE RANDOM 
VARIABLES 


Basic Formulas 


The most frequently used characteristics of discrete random variables are 
the moments of these variables. 

The moments m, and the central moments p, of the kth order of discrete 
random variables are defined by the formulas: 


My 


M[X*] ss 2 xipi, 


He = MUX — 34} = 3 i — Dr, 


in which M[X*] is the expectation of X*, x, are the possible values of a random 
variable X, p; the probabilities of these values and x is the expectation of Y. 
Therefore, the first moment is determined by the formula 


n 
x= MLX] = a XiPis 
the second central moment or the variance is given by 


D[X] = MI(X - 8] = > Gi — De, 
or by 
D[X] = M[X?] — (MIX)? 


The mean-square deviation o is given by the relation 
o =+VD[X]. 


If the probabilities of different values of X¥ depend on the disjoint or mutually 
exclusive events A,, then the conditional expectation of X with the condition 
that A, occurs is 


M[X| Au] = 3 P(X = x: | Ay). 


If A, (kK = 1, 2,..., m) form a complete set of events: that is, >Z_, P(A,) = 1, 
then the total expectation of X and the conditional expectation are related by 
the formula 


MUX] = M(MLX | Ax]} = 3 MUX | As]P(4,). 
In all the preceding formulas the number of terms in the sums can be 
infinite; in this case, for the existence of the expectation the sum must converge 
absolutely. 


SOLUTION FOR TYPICAL EXAMPLES 
Example 12.1. From a lot containing 100 items of which 10 are defective, 


a sample of five items is selected at random for quality control. Find the expec- 
tation for the number of defective items contained in the random sample. 
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SoLuTION. The random number of defective items contained in the sample 
has the following possible values: 
xy = 0; Dm Neo... Re Sy. Oy Sa A ee 5 
The probability p; = P(¥ = x) that Y will assume a given value x; is (see 
Example 10.1!) . . 
Cio'Cooh 
(Ph a (i=l, 2; 3; 475,60). 


100 


The required expectation is 





: CioiC3* oS 
x= i- 1) —- = Ci Caaf, 
2 ) C3o0 C200 23 10 30 


Since 8.9 CioC8o" is the coefficient of u° in the product (1 + uy + u)%, 
we see >$- jCioC 80’ is the coefficient of u° in the expression 


Se. + oP + WP + Year = 10 + WY". 


Consequently, we have 


_ 10CSo 


5 
> jCioC8o? = 10C$, or ¥ =e = 0.5. 
j=0 Cio 





Similarly, one can solve Problems 12.1 and 12.2. 


Example 12.2. A discrete random variable X is given by the distribution 
series p, = P(X = k), k = 1, 2,3,.... Express the expectation of X in terms 
of the generating function G(u) (see Section 9). 


SOLUTION. By the definition of the expectation of a random variable: 
M[X] = > kpx- 
k=1 


On the other hand, the value of the derivative of the generating function 
computed at u = | is 
=" > kp,,- 
1 k=1 








= » kp,u"-* 
=1 k=1 





u u= 


Consequently, 
M[X] = G'(1). 


One can solve Problems 12.3 to 12.6 and 12.24 to 12.26 similarly. 


Example 12.3. An experiment can be a success with the probability p and 
a failure with the probability 1 — p. 
The conditional probability P(m) for achieving the desired result after m 


successful trials is 


PAS i= (1 - =)" ee 


Find the expectation of the number of independent trials necessary for 
achieving the desired result. 
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SOLUTION. Let P,(A) denote the probability of achieving the desired result 
in 7 trials. If P, , is the probability of exactly m successes out of a total of 
trials, then, according to the formula for the total probability, we have 


P,(A) = 3 Pam P(e). 


Since the trials are independent, and the probability of a successful outcome 
in each of them is p, 
Prim = Ch pl =p a 


Substituting into the formula for P,(A) the values of P, , and P(m), we 
obtain 


P(A) = > cara — pyem{r - (1-2) par -(1-2Y- 


To attain the desired result, exactly trials are necessary if it will be attained 
at the th trial. The probability of the latter circumstance is P,(A) — P,- (A). 
Consequently, MLX], the expectation of the random number of trials necessary 
to attain the desired result, is: 


2 Anas Raia Daye s) = (he) 


| 
Ms 


M[X] 


ll 
Els 
3 
HN 8 
my 
_ 
| 
Els 
Se 
a 
| 


To compute the last sum we make use of the equality 


< adc d l 1 
al a. To a ‘ 
2, 7 7 dx 2 7 dx ; | (1 aa x)? 


valid for |x|< 1. Here, setting x = 1 — p/w, we obtain 


i 
M[X] = £ ee 
Pate 
wW 
Similarly Problems 12.10 to 12.15, 12.21 and 12.31 can be solved. 


Example 12.4 A device has 7 fuses. In the case of overload, one of the fuses 
burns out and is replaced by a new one. What is the expectation M[N] of the 
number of overloads N after which all the initial fuses of the device are replaced 
by new ones if one assumes that it is equally likely for all fuses (old or new) to 
burn out? 


SOLUTION. Let us denote by M[N | k] the expectation of the number of 
overloads after which all the initial fuses will be replaced if & fuses have not yet 
been replaced. 

To compute M[N | k] we use the formula for the total expectation. If k 
fuses (k > 1) remain nonreplaced, then, in order that one of them burns out, a 
subsequent overload is necessary. The average number of overloads necessary 
for a remaining fuse to burn out will depend on the result of the subsequent 
overload. 
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In the subsequent overload there can occur two events: 

A, that one of the initial fuses burns out with the probability P(4,) = k/n; 
A, that one of the replaced fuses burns out with the probability P(A,) = 
1 — k/n. 

If at the subsequent overload A, occurs, then the expectation of the number 
of overloads necessary for the replacement of all k fuses that have not been 
replaced before this overload is 1 + M[N|k — 1]. If at the subsequent over- 
load A, occurs, then the expectation equals 1 + M[N|k]. Using the formula 
for the total expectation, we find 


MLN | k] =“ +MIN|k— 1} + (1 ~ “a + MIN | k} 


k 


=1+—M[N|k— 1} + mas 


n 
n 





M[N | k] 
or after simple transformations, 
M[N | k] — MIN|k — 1] =T 


If k = 1, that is, only one fuse has not been replaced, the probability of its 
replacement equals I/n. Therefore, according to Example 12.3, we shall have 


M[N | l] =n. 
Thus, we have a chain of equalities 


MN | n] — M[N |n — =<, 





MIN |n— 1] - MIN |n-2])=—*_, 
MIN | 3] — M[N| 2] = 3 
MIN | 2] — MIN | 1] = 5; 
M[N | 1] = 2, 
whose sum gives 
MIN |nJ== 4+ "4 2 get bt Sta 


Or 





feed oe 
M[N] = MIV|n)=n(l +5 +3 4+ 5 +5): 


Problems 12.16, 12.20, 12.22 and 12.23 can be solved in a similar manner. 


Example 12.5 As a result of experiments with two devices A and B, one 
finds the probability of observing a noise whose level is evaluated in a three- 
point system (see Table 6). 
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TABLE 6 







1 
0.20 
0.06 


Noise level 









Device A 


The probability of 
Device B 


observing a noise 
of a given level 






Using the data from Table 6, select the better device, i.e., the device with 
lower noise level. 
SOLUTION. Let X denote the random noise level. The average noise level 
for the device A is 
M,[X] = 0.20-1 + 0.06-2 + 0.04-3 = 0.44 db. 


For the device B: 
M,[X] = 0.06-1 + 0.04-2 + 0.10-3 = 0.44 db. 
Thus, compared according to the average number of points, both devices are 


equivalent. 
As an additional criterion for comparison, we use the mean-square deviation 


of the noise level. 
o, = VD,[X] = VM,[X2] — &,)? = V0.80 — 0.442 = 0.78 db., 


og = VD,[X] = VM,[X?] — (%,)? = V1.12 — 0.442 = 0.96 db. 
Hence A gives a more stable indication with respect to the means and, 
consequently, it is better than B. 


2 


I 


PROBLEMS 


12.1 Find the expectation of the number of devices failing in 
reliability tests if in each test only one device is tested and the proba- 
bility of its failure is p. 

12.2 Assuming that the mass of a body can take, with equal 
probability, any integral number of grams on the interval | to 10, deter- 
mine for which of the three sets of weights (a) 1, 2, 2, 5, 10; (b) 1, 2, 3, 4, 
10; (c) 1, 1, 2, 5, 10, the average number of necessary weights will be 
minimum, if one can place weights only on one scale and the selection of 
weights is made to minimize the number used in the process of weighing. 

12.3 A certain device consisting of five elements is tested. The 
probability that an element numbered j fails to operate is 


pi = 0.2 + 0.1G — 1). 


Find the expectation and the variance of the number of elements 
“that stop if the failures of the elements are independent. 

12.4 Three devices are tested independently. The probabilities of 
failure for each device are p,, Po and ps, respectively. Prove that the 
expectation of the number of devices failing to operate is p, + po + Ps. 
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12.5 Determine the expectation of the number of devices failing 
to operate during a test period if the probability of failure for all 
devices is p and the number of devices that are tested is n. 

12.6 A lottery distributes m, prizes worth k,, mg; Ko,..., Mn 
and k,. The total number of tickets is N. What should be the cost of 


a ticket so that the expectation of a prize per ticket 1s equal to half its 
cost. 


12.7 The first player tosses three fair coins and the second, two 
fair coins. The winner, who gets all five coins, is the one who scores more 
heads. In the case of a tie the game is repeated until there is a decisive 
result. What is the expectation of winning for each of the players? 

12.8 Three persons A, B and C play a game as follows: two par- 
ticipate in each game; the loser cedes his place to the third person; the 
first game is played by A and B. The probability of winning each game is 
1/2 for each player. They continue to play until one of them wins two 
games in succession and gets m dollars. What is the expectation of a gain 
for each of the players (a) after the first game under the assumption that 
A won it, (b) at the beginning of the game? 

12.9 Three persons A, Band C play a game as follows: two players 
participate in each game; the winner cedes his place to the third person; 
first A plays with B. The probability of winning each game is 1/2 for each 
player. They continue to play until one of them wins two consecutive 
times and gets a sum of money equal to the number of all games played. 
What is the expectation of winning for A and C at the beginning of the 
game? 

12.10 An automatic line in a state of normal adjustment can pro- 
duce a defective item with probability p. The readjustment of the line is 
made immediately after the first defective item has been produced. Find 
the average number of items produced between two readjustments of 
the line. 

12.11 The probability that a call signal emitted by one radio 
station is received by another is 0.2 at each emission. The call signals are 
emitted every five seconds until an answer signal is received. The total 
passage time for the call and answer signals is 16 seconds. Find the 
average number of call signals emitted before a two-way connection has 
been established. 

12.12 Find the expectation and the variance of the number of 
items produced between two readjustments in a production line in nor- 

mal adjustment if in the state of normal adjustment, the probability of a 
defective item is p, and the readjustment is made after the kth defective 
item has been produced. 

12.13 The conditional probability that a device stops, computed 
under the assumption that m elements fail to operate, has the form: 

(a) for the device A 


P(m) = 1—e7™ (« > 0; m= 0,1, 2,...); 
(b) for the device B 


0 for m=O, 
ca) {i —e-™-V) for m= 1,2,3,... 
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/ 1/4 FIGURE 12 
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Find the expectation of the number of nonoperating elements that lead 
to stops of the devices A and B. 

12.14 A blocking scheme consisting of the relay A connected in 
series with two relays B and C, which are connected in parallel, must en- 
sure the closing of the circuit between the terminals J and II (Figure 12). 
As a result of damage, the relay A can stop with the probability 0.18, 
and the relays B and C with equal probabilities 0.22. Find the average 
number of times that the scheme is turned on until the first failure 
occurs. 

12.15 A certain device contains the elements A, B and C, which 
can be affected by cosmic radiation and stop operating if at least one 
particle hits them. The stoppage of the device occurs in the case of failure 
of the element A or a simultaneous failure of the elements B and C. Find 
the expectation of the number of particles that caused the stoppage of 
the device if the conditional probabilities that a particle reaching the 
device hits the elements A, B and C are 0.1, 0.2 and 0.2, respectively. 

12.16 A certain device has n elements of type A and m elements of 
type B. If one element of type A ceases to operate, it is not replaced and 
the device continues to operate until there remains at least one non- 
defective element of type A. The elements of type B are replaced re- 
peatedly if they fail so that the number of nondefective elements of type 
B remains constant in the scheme. The failures of each of the non- 
defective elements of the device are equally probable. Determine the 
average number of element failures leading to a total stoppage of the 
device, i.e., to nonoperation of all the ” elements of type A. 

12.17 Prove that the variance of the number of occurrences of an 
event in the case of a single experiment does not exceed 1/4. 

12.18 Find the conditions under which the third central moment 

of the binomial distribution is zero. 
12.19 The distribution function of a random variable YX is given by 
the equality 


F(x) = 2 Cnpm( =pyro. 


Prove that if lim,.... np = a, then lim,.... DIX] = a. 

12.20 Ten balls are drawn in succession from an urn containing a 
very large number of white and black balls mixed in equal proportion. 
The balls drawn before the first black ball occurs are returned to the urn; 
the first black ball that appears, together with all those that follow, is 
placed in another urn, which is initially empty. Find the expectation 
of the number of black and white balls in the second urn. 

Solve the same problem under the assertion that the number n of 
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balls drawn is random and obeys Poisson’s law with parameter a = 10; 
that is, 


He 
P(n = k) = Ge’. 


12.21 A game consists of tossing a fair coin until heads shows up. 
If heads appears at the kth tossing, player A gets k dollars from player B. 
How many dollars should A pay to B before the game starts so that the 
expectation of loss for each player is zero (i.e., the game is “fair’’)? 

12.22 A motor transport column can arrive at a service station at 
any instant of time. If 7 repairmen are scheduled on duty by method A, 
the average number of cars serviced equals np. If they are scheduled by 
method B, the number »[l — (1 — p)?] will be serviced if the column 
arrives during the first two quarters of 24 hours, np if the column arrives 
during the third quarter of 24 hours, and 0.5 np if the column arrives 
during the last quarter of 24 hours. 

For what values of p should one prefer the scheduling by method B? 

12.23 A repairman services n one-type machines, which are in a 
row at a distance a apart from one another. After finishing the repair on 
one machine, he moves on to the machine that needs service before all 
the others. Assuming that malfunctions of all machines are equally 
probable, compute the average distance this repairman moves. 

12.24 A random variable X¥ may assume positive integral values 
with probabilities decreasing in a geometric progression. Select the first 
term and the ratio of the progression so that the expectation of X is 10, 
and under this assumption compute the probability P,, that ¥ < 10. 

12.25 A random variable X can assume any integral positive value 
n with a probability proportional to 1/3”. Find the expectation of XY. 

12.26 An experiment is organized so that a random variable X 
assumes the value 1/n'with the probability 1/n, where 7 is any positive 
integer. Find MLYX’]. 

12.27 A game consists of repeated independent trials in which the 
event A can occur with the probability p. If A occurs inn > 0 consecu- 
tive trials, and does not occur at the (” + 1)st trial, the first player gets 
y” dollars from the second player. If n = 0, the first player pays one 
dollar to the second. Determine the quantity y under the assumption that 
the game will be “‘fair,” i.e., the expectation of a gain for both players 
is 0. Consider the case when p = 1/13. 

12.28 Balls are drawn from a box containing m white and n black 
balls until a white ball appears. Find the expectation of the number of 
balls drawn and its variance, if each ball is returned to the box after 
each draw. 

12.29 Consider two boxes with white and black balls: the first 
contains M white balls out of a total of N, and the second contains M, 
white balls out of a total of N, balls. An experiment consists of a 
simultaneous random drawing of one ball from each box and transfer to 
the other box, after which the balls are mixed. Determine the expecta- 
tion of the number of white balls in the first box after a given number 
of k trials. Consider the case when k — 0, 
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12.30 Communication with a floating research station is main- 
tained by 7 radio stations. The station that enters in a two-way connec- 
tion is the one that first receives the call signals from the floating station, 
and the occurrence of this event is equally probable for each of the radio 
stations (p = 1/n). The floating research station will communicate m 
times. Determine the probability that radio station No. 1 will be in- 
volved k times. Find the expectation and the variance of the number of 
times radio station No. 1 communicates. 

12.31 The independent trials of a device are repeated until a stop 
occurs. The probability p of a stop is the same for each trial. Find the 
expectation and the variance of the number of trials before stop. 

12.32 Two persons toss a coin in turn until both get the same num- 
ber of heads. The probability that after 27 tossings both will have an 
equal number of heads is 

_ (2n — 2)! 
Pn = 220-Inl(n — DH! 


Determine the expectation of the number of tosses. 


13. NUMERICAL CHARACTERISTICS OF CONTINUOUS 
RANDOM VARIABLES 


Basic Formulas 


The expectation x = M[X] and the variance D[X] of a random variable X 
with the probability density f(x) can be computed by the formulas 


F=M[X]= | xf(x) de, 


DLX] = ‘i GCaDyC de 


In the first case it is assumed that the integral converges absolutely. 

The expectation and the variance of continuous random variables have the 
same properties as the analogous quantities for discrete random variables. The 
mean-square or standard deviation o is defined by the formula 


c= +VD[X]. 


For a symmetric distribution law one may define as a dispersion charac- 
teristic of a random variable the mean deviation F, determined by the condition 


P(|X — x| < F) = - 


The moment of kth order m, and the central moment of kth order p, 
can be computed according to the formulas 


" m, = | x*f(x) dx, 


pe =| (&— OO) ar. 
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Example 13.1 The probability density for the random rolling amplitudes 
of a ship has the form (Rayleigh’s law) 


{= Z exp {35} (x > 0). 


Determine (a) the expectation M[X], (b) the variance D[X’], and the mean- 
square deviation o, (c) the central moments of third and fourth order pg and pg. 


SOLUTION. The computation of the moments reduces to the evaluation of 
integrals of the form 


i i t™e-” dt (n > 0 is an integer) 
0 


which for even n are 


1 ! 2h TM 
Jon = 30K + 5) = Sper Va. 


where 
(2k — 1)!! = Qk — 1)Q2k — 3)2k — 5)---7-5-3-1, 


and for odd n 
1 k! 
Jara = ak + 1) = oe 


(a) The expectation of a random rolling amplitude is 

o - ee ey ee 2 

¥ =M[X] = i xf(x) dx = al x exp { x} dx. 
Performing the substitution x/(aV 2) = t, we obtain 


— fo.0) _ - Ay 
M(x] = 2Via { Pe? dt = 2V2aJ» = 579 ja =a 5 
0 
Thus, 





= M[X] =a ae 
(b) Since 
of = DX] = M[X?] — (x)? = 4a°Uy — 5a? = a°(2 3 5): 
then 
= a,/2 — 5 
(c) pug = M[(X — ¥)°] = mg — 3Xm,_ + 2(%)°, 


where m; = 4V2a°J4 = 3a2-V 77/2. 
Consequently, 


7 
aGLa 
M[(X = x)‘] = M,— 4xmz, + 6xX7My = ax*: 


M4 
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where m, = 8a*/, = 8a*. Hence 
ba = at(s = 57). 
Similarly one can solve Problems 13.1 to 13.13, 13.22 and 13.23. 
Example 13.2 Find the mean deviation of a random variable whose 
probability density (the Laplace density) has the form 
1 
=e |*l 
T(x) Zell 


SOLUTION. Since the probability density is symmetric with respect to 
zero, it follows that ¥ = 0. The mean deviation E is computed according to 


the formula 
1 E | E 
2 SPH =] SB) - | ze lde = { e-* dx = 1— e-®, 


From this it follows that E = In2 = 0.6931. 
In a similar way Problems 13.1 and 13.4 can be solved. 


PROBLEMS 
13.1 The probability density of a random variable X has the form 
1 
fos = {3 for |x —a| < J, 
0 for |x-—a|>l. 


Determine (a) M[X] and (b) DLX]; (c) find the relation between 


the mean-square and mean deviations of X. 
13.2. The distribution function of a random variable X has the 


form 


0 for x<-l, 
F(x) =<a+baresinx for -l<x<l, 
1 for l<x. 


Find the constants a and b. Compute M[X] and DLX’]. 
13.3. Determine the expectation and the variance of a random 


variable X if the probability density is 
ae P By 
— exp<—p’?=> for x20, 
fa) =(EVn |? EB 
0 for x <0. 


13.4 The probability density of a random variable X has the 
form (the arcsine law) 
1 
1 ae oa ore (-a<x<a). 


Determine the variance and the mean deviation. 
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13.5 The probability density of the random rolling amplitudes 
of a ship is given by the formula (Rayleigh’s law) 


S(@ = 5 exp {-3}; 


in which o? is the variance of the angle of heel. 
Are the amplitudes smaller and greater than the average en- 


countered with the same frequency? 
13.6 The velocities of the molecules of a gas have the probability 


density (Maxwell’s law) 
fv) = Avte"?” (v > 0). 


Find the expectation and the variance of the velocity of the 
molecules and also the magnitude of A for given h. 
13.7. The probability density of a random variable X is given 
in the form 
for x <0, 


0 
fe) —e-* for x > 0. 


Find M[X] and D[X]. 
13.8 Find the expectation and the variance of a random variable 
whose probability density has the form 
3 
x 
F(x) = 1 - a for x 2X, (xX > 0). 
0 for x < Xp 
Find M[X] and DLX]. 
13.9 Find the expectation and the variance of a random variable 
whose probability density has the form (the Laplace density) 


fo) = 5e7™ 
13.10 A random variable X has the probability density (the beta- 
density) 
x 
Ax* exp {—3} for x 20 (2 >-1; 8 > 0), 
f(x) = B 
0 for x <0. 


Determine the parameter A, the expectation and the variance of 


the random variable X. 
13.11 A random variable XY has the probability density (beta- 


density) 


f(x) = 


Find the parameter A, the expectation and the variance of the 
random variable X. 


(lore for O<x<1 (@>0;5b>0), 
0 for x <0 and x> 1. 
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13.12 A random variable X has the probability density 
fo) = AQ + 22-8, 


where n > | is a positive integer. Determine the constant A, the expec- 
tation and the variance of the random variable X. 


13.13 The probability density of a nonnegative random variable X 
has the form 


2 
Six Axt-? exp { 5 , 
in which n > 1, 


Find A, the expectation and the variance of X. 
13.14 Prove that if the conditions 


lim [xF(x)] =90 and lim {x[{l — F(x)}} = 0 


are satisfied, then for the expectation of a random variable the following 
equality holds true: 


MLY] = i [l — F(x)] dx — fo F(x) dx. 


13.15 The probability of finding a sunken ship during a search 
time ¢ is given by the formula 


p(t) =1—-—e-™* (y > 0). 


Determine the average time of search necessary to find the ship. 

13.16 Find the expectation m(t) of a mass of radioactive substance 
after time ¢ if initially the mass of the substance was mo, and the 
probability of nuclear disintegration of any atom per unit time is a 
constant p. 

13.17 Find the half-life of a radioactive substance if the proba- 
bility of nuclear disintegration of any atom per unit time is a constant p. 
(The half-life period 7, is defined as the instant when the mass of the 
radioactive substance is one-half its initial value.) 

13.18 The processing of the results obtained in a census has 
shown that the differential distribution law of the ages of persons 
involved in research can be represented by the formula 


f(t) = k(t — 22.5)(97.5 — 1)® (tis time in years, 22.5 < t < 97.5). 


Determine how many times the number of scientific workers under 
the average age exceeds those above the average. 


13.19 Determine for Student’s distribution given by the proba- 
bility density 


nl 
TAX) = fee (1 " lee 
2 


the moments m, for k <n. 
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13.20 A random variable X¥ obeys the beta-density; i.e., it has the 
probability density 


= Te+9 p-l(] — y)\e-1 . : 
f(x) = Tip) x (I x) (O<x< l;p >0;q> 0). 
Find the moment of kth order. 
13.21 Find the expectation and the variance of a random variable 
having the probability density 2/7 cos? x on the interval (—7/2, 7/2). 
13.22 Express the central moment p, in terms of the moments, 
13.23 Express the moment m,, in terms of the central moments 
and the expectation x. 


POISSON’S LAW 


Basic Formulas 


The distribution series of a random variable X has the form 


™ 


P(X = m) = P, = P(m, a) = <e-*, 


in which a = M[X’, is called the Poisson distribution law. 
Poisson’s law can approximately replace the binomial distribution in the 
case when the probability p of occurrence of an event A in each trial is small 
and the number n of trials is large. In such a case, the approximate equality 


™ 


a -a 
Pet Opel py ae mie : 


in which a = np, holds true. 


SOLUTION FOR TYPICAL EXAMPLES 
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Example 14.1 A radio device consists of 1000 electronic elements. The 
probability of nonoperation for one element during one year of operation 
is 0.001 and is independent of the condition of the other elements. What 
is the probability that at least two elements will fail to operate during a 
year? 


SOLUTION. Assuming that the random number X of nonoperating elements 
obeys Poisson’s law 


P(X = m) = P, = — 


-@a 
mi © : 
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where a = mp = 1000-0.001 = 1, we obtain the following: 
(1) the probability that exactly two elements fail to operate is 


2 
T e-e = | _ 0184; 


PCY = 2) = ee 
(x )= Pr pile 2e 


(2) the probability that at least two elements fail to operate is 


P(X>2)= > Ph=1—P—P,=1-e7{(1 +a) 
m=2 


~1— 2% 0.264. 
e 


Similarly one can solve Problems 14.1 to 14.7. 


Example 14.2. An explosion of a balloon during a reliability test generates 
100 fragments that are uniformly distributed in a cone bounded by angles of 
30° and 60° (Figure 13). Find the expectation and the variance of the number of 
fragments reaching | sq. m. of the surface of the sphere located inside the cone 
if the radius of the sphere is 50 m. and its center coincides with the point of 
explosion. 


SOLUTION. Let a sphere of radius 50 m. intersect the cone formed by 
fragments and let us determine the expectation of the number of fragments 
passing through a unit area of the spherical zone formed by the intersection of 
the cone with the sphere. Let S denote the area of this zone: 


2n 713 
S = 50? | | ieedeunS 5000n(cos 7 Zee 3) 
0 Jn/6 6 3 


= 250007(V3 — 1) © 5725 sq. m. 


Since the total number of fragments is N = 100, the expectation for a 
fragments passing through a unit area of the surface of the spherical zone 


will be 


N _ 100 . 
3 = 5795 = 0.01745 splinters. 


a= 


The probability that a given fragment will reach a given area Sy = 1 sq. m. 
is small (it equals S)/S = 1.75-10~*), therefore, one may consider that the 


FIGURE 13 
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random number of fragments reaching 1 sq. m. of the surface of the sphere is 
distributed according to Poisson’s law and, consequently, the following equality 
is valid: 

D[X] = MLX] = a = 0.01745. 


In a similar way one can solve Problems 14.10 and 14.12. 


PROBLEMS 


14.1 The expectation for the number of failures of a radio device 
during 10,000 hours of operation is 10. Find the probability that the 
device fails to operate during 100 hours. 

14.2 The probability that any telephone subscriber calls the 
switchboard during one hour is 0.01. The telephone station services 
300 subscribers. What is the probability that four subscribers will call the 
switchboard during one hour? 

14.3. A device contains 2000 equally reliable elements with the 
probability of failure for each of them equal to p = 0.0005. What is the 
probability that the device will fail to operate if failure occurs when at 
least one element fails to operate? 

14.4 A switchboard receives an average of 60 calls during one 
hour. What is the probability that during 30 seconds in which the 
operator is away there will be no calls? 

14.5. The probability that an item will fail to pass a test is 0.001. 
Find the probability that from a total of 5000 items more than one item 
will fail. Compare the results obtained using Poisson’s distribution with 
those obtained with the binomial distribution. In the latter, make use of 
logarithm tables with seven significant digits. 

14.6 During a certain period of time the average number of 
connections to wrong calls per telephone subscriber is eight. What is the 
probability that for a preassigned subscriber the number of wrong 
connections will be greater than four? 

14.7 Find the probability that among 200 items tested, more than 
three will turn out to be defective if the average percentage of defective 
items is | per cent. 

14.8 The proofs of a 500-page book contain 500 misprints. Find 
the probability that there are at least three misprints per page. 

14.9 Inthe observations made by Rutherford and Geiger, a radio- 
active substance emitted an average of 3.87 «-particles during 7.5 
seconds. Find the probability that the substance will emit at least one 
a-particle per second. 

14.10 Determine the asymmetry coefficient of a random variable 
distributed according to Poisson’s law. (The asymmetry coefficient is the 

quotient S, = p3/0*.) 

14.11 During its flight period, the instrument compartment of a 
space ship is reached by r elementary particles with the probability 


P(r, A) = x eo”: 
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The conditional probability for each particle to hit a preassigned unit 
equals p. Find the probability that this unit will be hit by (a) exactly k 
particles, (b) at least one particle. 

14.12 Find the variance for the number of atoms (of a radio- 
active substance) that decay in a unit time if the mass of the substance is 
M, the half-life is T,, the atomic weight is A and the number of atoms 
in a gram-atomic weight is No.” 

14.13 Determine the probability that a screen of area S = 0.12 
sq. cm. located at a distance r = 5 cm. perpendicular to the flow of 
«-particles emitted by a radioactive substance is hit during one second 
by (a) exactly 10 a«-particles, (b) not less than two a-particles, if the 
half-life of the substance is 7, = 4.4- 10° years, the mass of the substance 
ism = 0.1 g., and the atomic weight is A = 238.? 

14.14 Prove that the multinomial distribution 


P,(k;, ko, ees Kas Km+1) = Chit = *m pti p52 . poet’, 
in which 
Pi + Pe +---+ Dm + Pmii = Ls 


and 
ki + ke Hi Os Re er St, 


can be approximated by the multidimensional Poisson law 


fede. «2 


Uke lsek 


7 Ay tagton tag) 


in which A, = np;, if all the probabilities p, except for p,,., are small 
and nis large. 


158. THE NORMAL DISTRIBUTION LAW 


Basic Formulas 


The probability density of a normally distributed random variable has the 


form 
fe eee 


oV 2x 





or 





in which o is the mean-square deviation, E = pV2c is the mean deviation 
(sometimes also called “probable deviation’’), and p = 0.476936.... 

2 Ignore scattering and absorption of particles. Avogadro’s number, No = 6.02 x 107%, 
is the number of atoms in a quantity of the substance whose mass in grams equals its atomic 
weight. The half-life 7, is the time during which a mass of the substance decays to half the 
original mass. 
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The probability that a normally distributed random variable X assumes 
values on the interval (x,, x2) can be computed by using one of the following 
formulas: 


(1) P(x, < ¥ <x) = ; |o(2=) S o(—-)], 


Co 


O(x) = == | exp {-5} dt 


is the Laplace function (probability integral); 


in which 








Oj. Peer esyS ; |o(=5 *) = 6(3 *)| 


in which 


is the normalized Laplace function. 
The values of the functions ®(x) and (x) are given in 8T and 11T in the 
table list on pages 471, 472. 


SOLUTION FOR TYPICAL EXAMPLES 


Example 15.1. The measurement of the distance to a certain object is 
accompanied by systematic and random errors. The systematic error equals 
50 m. in the direction of decreasing distance. The random errors obey the 
normal distribution law with the mean-square deviation o = 100 m. Find 
(1) the probability of measuring the distance with an error not exceeding 150 m. 
in absolute value, (2) the probability that the measured distance does not exceed 
the actual one. 


SOLUTION. Let X denote the total error made in measuring the distance. 
Its systematic component is x = —50 m. Consequently, the probability density 
of the total errors has the form 





Fe= ] (x + ee 


— exp 4 — 
100V 2 20,000 
(1) According to the general formula, we have 


P(|X| < 150) = P(—150 < ¥ < 150) 
a fo(iss a: 50) = o(=19 - so) 


2 100 100 


= 5 (@) ~ (-1). 


The probability integral is an odd function and, hence, 


@(—1) = —O(1). 
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From this we get 
P(|X| < 150) = 5 [0(2) + (1). 


From 8T in the table list, we find 


@(2) = 0.9545, (1) = 0.6827; 
and, finally, 
P(|X| < 150) = 0.8186. 


(2) The probability that the measured distance will not exceed the actual 
one is 


P(—co < X < 0) = 5 (000.5) + &(~)]. 
Since ®(co) = lim,.... P(x) = 1, and from 8T in the table list, page 471, we 
find ®(0.5) = 0.3829, it follows that 
P(—co < X < 0) = 0.6914. 
Similarly one can solve Problems 15.1 to 15.4 and 15.10 to 15.14. 


Example 15.2 Determine the mean error of an instrument with no 
systematic errors, and whose random errors are distributed according to the 
normal law and fall with the probability 0.8 within the bounds +20 m. 


SOLUTION. From the assumption of the problem, it follows that 
P(|X| < 20) = 0.8. 


Since the probability density of the random errors is normal, and x = 0 
(the systematic error is absent), we have 


1 [- /20 20 2 {20 
rox 29 = 1[6(2) -o(-3)] (2) 
The unknown value of the mean error is determined as the solution of the 
transcendental equation 


; {20 
o(5) ais: 
Using 11T in the table list on page 472, we find 
20 
Eo 1.90, 
from which it follows that 
20 
E= 196 = 10.5 m. 


In a similar way one can solve Problems 15.8 and 15.18. 


PROBLEMS 


15.1 A measuring instrument gives a systematic error of 5 m. and 
a mean error of 50 m. What is the probability that the error of a measure- 
ment will not exceed 5 m. in absolute value? 


15. 
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15.2 The systematic error in maintaining the altitude of an air- 
plane is +20 m. and the random error is characterized by a mean 
deviation of 50 m. For a flight, the plane is assigned a corridor 100 m. 
high. What are the probabilities that the plane will fly below, inside and 
above the corridor if the plane is given an altitude corresponding to the 
midpoint of the corridor? 

15.3. The mean error in distance measurements with a radar device 
is 25 m. Determine (a) the variance of the errors of the measurements, 
(b) the probability of obtaining errors not exceeding 20 m. in absolute 
value. 

15.4 A measuring instrument has a mean error of 40 m. and no 
systematic errors. How many measurements should be performed so 
that in at least one of them, the error will not exceed 7.5 m. in absolute 
value with a probability greater than 0.9? 

15.5 Given two random variables X and Y with equal variance, 
one being distributed normally and the other uniformly, find the 
correlation between their mean deviations. 

15.6 A normally distributed random variable X has the expecta- 
tion x = —15 m. and the mean deviation 10 m. Compute the table for 
the distribution function for values of the argument increasing by 10 m. 
and plot the graph. 

15.7 An altimeter gives random and systematic errors. The 
systematic error is +20 m. and the random errors obey the normal 
distribution law. What should be the mean error of the instrument so 
that the error in altitude measurement is less than 100 m. with the 
probability 0.9? 

15.8 Find the relation between the arithmetic mean deviation 


E, = M[|X — x|] 


of a normally distributed random variable and its mean-square 
deviation. 

15.9 For a normally distributed random variable X with 
M[X] = 0 find (a) P(Y = ko), (b) P(|X| = ko) (for k = 1, 2, 3). 

15.10 The gunpowder charge of a shotgun is weighed on scales 
with a mean error of 100 mg. The nominal mass of the gunpowder 
charge is 2.3 g. Determine the probability of damaging the gun if the 
maximum admitted mass of the gunpowder charge Is 2.5 g. 

15.11 Two independent measurements are made with an instru- 
ment having a mean error of 20 m. and a systematic error of +10 m. 
What is the probability that both errors will occur with different signs 
exceeding 10 m. in absolute value? 

15.12 Two parallel lines are drawn in the plane at the distance L. 
On this plane, a circle of radius R is dropped. The dispersion center is 
located at distance 5 outward from one of the parallels. The mean 
deviation of the center of the circle in the direction perpendicular to 
this parallel is EF. 

Determine for one throw (a) the probability that the circle will 
cover at least one of the parallels, (b) the probability that it will cover both 
parallels, if2 = 10m, R = 8m.,5 =5m. and £ = 10m. 
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15.13 A product is considered to be of high quality if the deviation 
of its dimensions from the standards does not exceed 3.45 mm. in 
absolute value. The random deviations of its dimensions obey the 
normal distribution with a mean-square deviation of 3 mm.; systematic 
errors are absent. Determine the average number of products of high 
quality from a total of four items produced. 

15.14 What should be the width of the tolerance field in order to 
obtain, with a probability at most 0.0027, an item whose size lies outside 
the tolerance field if the random deviations of the size from the mid- 
point of the tolerance field obey the normal distribution with parameters 
xX =Oando = Su? 

15.15 What should be the distance between two fishing boats sail- 
ing on parallel routes so that the probability of sighting a school of fish 
moving between the boats in the same direction is 0.5, if the width of 
the strip of search for each boat is a normally distributed random 
variable with parameters x = 3.7 km. and E = 0.74 km., and for 
different boats these quantities are independent? 

15.16 In many measurements it has been established that 75 per 
cent of the errors (a) do not exceed + 1.25 mm., (b) do not exceed 1.25 
mm. in absolute value. Replacing the frequencies of occurrences of the 
errors by their probabilities, determine in both cases the mean deviation 
of the distribution law of the errors. Assume the distribution is normal 
with zero expectation. 

15.17 The random deviation X of the size of an item from the 
standard obeys the normal law with the expectation ¥ and the mean- 
square deviation o. Nondefective items are considered to be those for 
which a < X < b. The items subjected to alteration are those for 
which X > 8, 

Find (a) the distribution function for the random deviations of the 
sizes of the items subject to alteration, (b) the distribution function for 
the random deviations of the sizes of nondefective items. 

15.18 A normally distributed random variable X has a zero expec- 
tation. Determine the mean deviation E, for which the probability 
P(a < X < b) will be largest (0 < a < 5). 


16. CHARACTERISTIC FUNCTIONS 


Basic Formulas 


The expectation of the function e“* (where u is a real variable, and 
i = V—1) is called the characteristic function E(u) of a random variable X: 


E(u) = M[e*]. 
For a continuous random variable we have 


EQ) = |” eesf(x) de, 


where f(x) is the probability density of the random variable X. 
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For a discrete random variable (and only for a discrete one) 


E(u) = 2 pre*e, 
k=1 


in which x, are the particular values of the random variable and p,, = P(X = x;,) 
are the probabilities that correspond to them. 
If the moment m,, exists, then 


d* E(u) 
du* 


The probability density f(x) is determined uniquely by the characteristic 
function: 





1 
nh = ML[X*] "= gk 





u=0 


+0 


tx) = ~ Le e~ E(u) du. 


For discrete random variables the last formula gives the probability 
density in the form of a sum of 6-functions. There is a one-to-one correspond- 
ence between distribution functions and characteristic functions. 


SOLUTION FOR TYPICAL EXAMPLES 


Example 16.1 A lot of 7 items contains m defective items. A sample of r 
items is drawn from the lot for quality control (m < r<n— mm). Find the 
characteristic function of the number of defective items contained in the sample. 


SOLUTION. The random variable X representing the number of defective 
items in the sample may assume all the integral values on the interval (0, m). 
Let us denote 

Py = P(X =k), where k=0,1,2,...,m. 


Determining p,, as the ratio between the number of equally probable (unique) 
mutually exclusive results of the experiment and the total number of results, we 
find 
CRCn—m 
Lt see 
Consequently, the characteristic function 
m Cc* Cc’ ak 
E(u) = ee et 
2, Ch 
Similarly one can solve Problems 16.1 to 16.5. 


Example 16.2 Find the characteristic function of a random variable X¥ 
with the probability density 


fo) = 56° 


SOLUTION. Since the characteristic function is 


EG) = i . e*f(x) dx, 
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this leads to 
+0 
E(u) = nails 


-@ 


in etu-Dx ax + 5 ie eliut Dx dx 


0 -2 











that is, 


Problems 16.6 to 16.12 can be solved in a similar way. 


Example 16.3. A random variable X has the characteristic function 
BOS Tae 
Find the probability density of this random variable. 


SOLUTION. The probability density f(x) is related to the characteristic 
function E(u) by 


Fy-e ~ i) ie e-™ E(u) du. 


Substituting the value of E(u), we obtain 
1 +o e7 tux 
1) = 95 |. ta 
We shall consider u as the real part of the complex variable w = u + iv. 
For x < 0 the integral over the real axis is the integral over a closed con- 
tour consisting of the real axis and the semicircle “of infinite radius” located 
in the upper half-plane (Figure 14); that is, 


+o e7tux 1 exw 


1 
IQ) = x nS re 3, tee ov: 


By the theorem of residues 


e—ixw : e7ixw 2 
$ 3 dw = 2ri( 5. ) = ne’, 





FIGURE 14 
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or, taking into account that x < 0, we have 


f(x) = 5 e7 


Similarly, for x > 0 


+0 en tux ] +o el% exw 
JOS el tee fe - = 54 aw, 
where the integration is extended over the same contour (Figure 14). 


According to the theorem of residues 
eixw 


1+ w? 


eixw E 
5 dw = ani) = me~*, 


or, using the fact that x > 0, we have 
fa) = 56°" 
Z 
Therefore, for any value of x 
fe) = 567, 
Similarly one can solve Problems 16.15 and 16.16. 


Example 16.4 Find the moments of a random variable X whose charac- 
teristic function is E(u) = 1/(1 + u?). 


SOLUTION. The moments exist up to any order since all the derivatives of 
E(u) are continuous at origin. Consequently, 


1 d*E(u) 


Mm, =F 
GF duk 





u=0 
We shall determine the derivatives 


d"E(u) 
du 








u=0 


as the coefficients of u*/k! in the expansion of the function 1/(1 + wu?) in a 
Maclaurin series; that is, we shall use the equality 











On the other hand, the function 1/(1 + wu?) for |u| < 1 is the sum of the geo- 
metric progression 


wo 


1 ] ~ 3,\2m 2m uem 7 
Ca 1 = ae Gi? = > (iuy?" = 2s (2m)! (my! 


m=0 
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Thus, the Maclaurin series of the function 1/(1 + u?) contains only even 
powers of u. It follows from this that 


d* E(u) 
du* 


= i*k! for k even, 
wo 0 for k odd, 








and the moments 


ee k! for k even, 
* \0 for k odd. 


In a similar way one can solve Problems 16.3, 16.7, 16.8, 16.10 and 16.14. 


PROBLEMS 


16.1. Find the characteristic function of the number of occurrences 
of an event in one trial if its probability of occurrence in one trial is p. 

16.2 Find the characteristic function of the number of occurrences 
of an event A in v independent trials if the probability of occurrence of 
A varies from one trial to another and equals p, (k = 1, 2,...,n) for 
the Ath trial. 

16.3 Determine the characteristic function of a discrete random 
variable X with a binomial distribution and also the corresponding 
M[X] and DLX]. 

16.4 Find the characteristic function of a discrete random 
variable X obeying Pascal’s distribution law 


— a” 
oa a Es ajyr* 


and the corresponding M[X] and D[X’). 
16.5 A discrete random variable X obeys Poisson’s law 


P(X = m) (a > 0), 


P(X = m) = sen". 


Find (a) the characteristic function E(u), and (b) using E(u), find 
M[X] and D[X]. 

16.6 Find the characteristic function of a normally distributed 
random variable with expectation ¥ and variance o?. 

16.7. Find the characteristic function and the moments of a ran- 
dom variable with the probability density 


* for x20, 
for x <0. 


fe) = {5 


16.8 Find the characteristic function and all the moments of a 
random variable uniformly distributed over the interval (a, b). 
16.9 A random variable X has the probability density 


f(*) = 2h?xe-”*? (x 3 0). 


Find its characteristic function. 
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16.10 A random variable X has the probability density 


A 

cs A-lj-ex 

40) = fF x te for x >0, CSO): 
0 for x <0 


Find its characteristic function and moments. 
16.11 Find the characteristic function of a random variable VY 


whose probability density (the arcsine law) is 


1 
I) 7 av a — x? 


(|x| < a). 





16.12 Find the characteristic function of a random variable X¥ 
obeying Cauchy’s distribution law: 


a 1 
IO) = 7 Get 
16.13 Using the expression 


uo 


E(u) = exp {ins — > 





for the characteristic function of the normal distribution law, determine 
the characteristic function of the random variable (a) Y = aX + b, 
(b) ¥= X¥ — x. 

16.14 Using the expression 


E(u) = exp {-“=\ 


for the characteristic function of a centralized random variable X that 
obeys a normal distribution law, determine all its central moments. 
16.15 The characteristic function of a random variable X is given 


in the form 





E(u) =e?! = (a > 0). 


Determine the probability density of X. 
16.16 Given the characteristic functions 


1+ iu 1 — iu 
Tee Pl) = Tp 
determine the corresponding probability densities. 
16.17 Given the characteristic function 
1 
EO oe 


show that it corresponds to a discrete random variable. Find the 
distribution series of this variable. 
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17. THE COMPUTATION OF THE TOTAL PROBABILITY 
AND THE PROBABILITY DENSITY IN TERMS OF 
CONDITIONAL PROBABILITY 


Basic Formulas 


The total probability of an event A is given by the formula 
+o 
P(A) = [” f@)P(A| ») de, 


in which f(x) is the probability density of the random variable X, on the values 
of which depends the probability of occurrence of A; P(A | x) is the probability 
of occurrence of the event A, computed under the assumption that the random 
variable x assumes the value x. 

The conditional probability density f(x | A) of a random variable X, Le., 
the probability density under the assumption that A occurred, is determined 
by the formula (the generalized Bayes formula): 


f(x)P(A | x) 


f(x | 4) = = 
im fCo)P(A | x) dx 


in which f(x) is the probability density, prior to the experiment, of the random 
variable X. 


SOLUTION FOR TYPICAL EXAMPLES 


Example 17.1 The probability of an event depends on the random 
variable X and can be expressed by the following formula: 


l1—e-** for x20, 
p(4| x) = {4 ay. (k > 0). 


Find the total probability of the event A if X is a normally distributed 
random variable with expectation ¥ and variance o?. 


SOLUTION. The total probability of the event A is 
+2 
P(A) = | f(X)P(A | x) dx. 


Substituting here the given probability density 
are, Gea 
I(x) = oV In exp {-S"}, 





we obtain 


p(4) = [amex {SPP ha — em ax 


0 


; 1 + o(2)] - Af exp {-" —e - kx} dx. 











il 
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The exponent of e in the last integral can be reduced to the form 


Jge 2a? 2 


— x 2)\2 2 
ape et co 


Consequently, 


r= $200] ~ 


=: Ae" ne (x — X + ko*)? 
x exp {-#( - =) [ exp {4} dx 
Since 
= o2)? i 2 
sie es ees aera) 


r= bho) - [1-9] wo[-1(e-42)}. 


Similarly one can solve Problems 17.1 to 17.10. 








then 





Example 17.2 The deviation of the size of an item from the midpoint of 
the tolerance field of width 2d equals the sum of two random variables X¥ and Y 
with probability densities 


fe) = rege {aa} 





and 


Determine the (conditional) probability density of the random variable Y 
for the nondefective items if the distribution y(y) does not depend on the value 
assumed by X. 


SOLUTION. Let A denote the event that an item produced turns out to be 


nondefective. The conditional probability P(A | x) of getting a nondefective 
item, under the assumption that the random variable X takes the value x, is 


fad Ocenia ae ard an aces 


Let f(x | A) be the conditional probability density of X for nondefective 


items so that 
flce| A) = LOPE |») 
S(x)P(A | x) dx 
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Substituting the values of f(x) and P(A | x), we obtain 


aE za Oa as) 




















or 
S(x| A) = shies aest 


d 
Tara) 
Vo + of 


PROBLEMS 


17.1 Suppose that a straight line is drawn in the plane and on it 
are marked points separated by the distance /. Determine the probability 
that at least one point will coincide with the center of a circle of diameter 
b and moving in the same plane so that its center describes a straight 
line intersecting the given line at an angle 6, equally probable over the 
interval (6,, 62). The angles 6, and 6, satisfy the conditions sin 6, < d/l 
and sin @, > b/1.) 

17.2 Oneach of two parallel lines, points are taken independently 
at a constant interval / = 100 m. Determine the probability that at 

least one point will lie in an infinite strip of width D = 25 m., located 
in the same plane as the two parallels so that the lines that bound it are 
perpendicular to these parallels. 

17.3. Find the probability of hitting a target in one trial if the 
distance to the target at the instant of the shot is a random variable 
uniformly distributed over the interval 100 to 200 m. and the conditional 
probability of hitting the target is 3000/D?, where D is expressed in 
meters. 

17.4 Ona shore of a bay of width L = 30 km. there is an observa- 
tion station whose distance of observation is a normally distributed ran- 
dom variable with the expectation x = 20 km. and mean deviation 
E = 1 km. A ship can pass with equal probability through the bay, 
while moving along the shore at any distance from the station. Find 
the probability that the observation station will discover the ship. 

17.5 On the right pan of a balance a load is placed whose mass 
obeys the normal distribution law with parameters x = 20 kg. and 
E = 1 kg. On the left pan another load is placed whose mass is equally 
probable within the bounds 0 to 50 kg. Determine the probability that 
the right pan will outweigh the left one. Compare the result with that 
obtained under the assumption that the load on the right pan is not 
random, but is exactly 20 kg. 

17.6 Consider a number n of independent measurements of a 
normal random variable X whose expectation coincides with the origin 
of the reference system and with mean deviation R. Find the probability 


17. 
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that the result of at least one measurement will deviate from the random 
variable Z by at most +r if Z is uniformly distributed over the interval 
(-f, 2). 
17.7. Given a sequence of random variables X;, X2,.., X, with 
the same probability density f(x), we call the random variable 

W, = Mies = Mantas 
in which X,,ax is the maximum and X,,, the minimum of the obtained 


values X, (j = 1, 2,..., 1), the range. 
Find the distribution function of the range 


F(w) = P(W, < w). 


17.8 What is the probability that two points selected randomly 
in a circle will lie on one side of a chord parallel to a given direction 
and whose distance from the center is a uniformly distributed random 


variable? 
17.9 The coordinates X, of the random points A,, Ao,..-., An 


have the probability densities 
Fix) (ee Taye dee Ks 


One of these n points coincides with a point Ag whose deviation of 

coordinates from a given number has the probability density f(x). 

Determine the probability that the point A will coincide with Ao. 
17.10 A random variable X obeys Poisson’s law 


P(X = m) = ens, 


whose parameter is unknown, but prior to the experiment the parameter 
has the probability density 
f(a) = ae~* (a > 0). 
After the experiment, a random variable X assumes the value mo. 
Find the probability density a after the experiment. 
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18. DISTRIBUTION LAWS AND NUMERICAL 
CHARACTERISTICS OF SYSTEMS OF RANDOM 
VARIABLES 


Basic Formulas 


The distribution function (integral distribution law) F(x,, X2,..-, X,) of a 
system of nm random variables (X,, X2,..., Xn) is defined by the formula 


F(x, Ret) = PCY, < Xis Xo < XQ, 2-25 XxX, < Xn). 


For a system of continuous random variables, there can exist a probability 
density (differential distribution law) defined by the formula 


OF (x, Xo,.-- “9 Xn) 


ar aaa VE, SST.) 


A system of discrete random variables is characterized by the set of proba- 
bilities PLY, = i,, X2 = ig,..., X, = i,), which can be reduced to a table with 
n rows (according to the number of random variables). 

The distribution function for continuous random variables can be ex- 
pressed in the form of a multiple integral 


Fin Xaje25%) = | Pe PO ft ayo a) dos tay 


and for discrete random variables in the form of the multiple sum 


PG es a ee = = eames : PON Ge tig A eS os eh, Ss 


41, <x, tg <x2Q in <Xn 


in which the summation is extended over all the possible values of each of the 
random variables for which 1, < x, ig < Xo,..., i, < Xp. 

For n = 2, a system of continuous random variables can be interpreted 
as a random point in the plane and for nm = 3 as a random point in space. 

The probability that a random point lands in a region S is obtained by 
integrating the probability density over this region. 
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The basic numerical characteristics of a system of m random variables are: 
the expectations, 


MX; ] -| { vf Kf (Xiy Hoy04 a5 Ky) dx Axg* dx, 


the variances, 


DIX] = kus oP = Pf [Gi — BPC) di dg ty 
and the covariances, 
MCX; br XX; = X;)] = k; 

= i i eas | (i= X;)(x; — Xj)f(X1, Xo, ..- Xn) dX, AX_q: + + dxy. 


The moments for discrete random variables can be computed similarly; i.e., 
the integration is replaced by summation over all possible values of the random 
variables. 

The second central moments form the covariance matrix 


ky, kie kis kin 
kor Koo kos Kon 

| ki|| = kgy Kz kz Kon ’ 
| kay kn kus Kin 


in which k,, = k,;. Sometimes it is very convenient to use the formula 
ky = M[X,X;] — M[X,]-M[X3]. 


The random variables X,, X2,..., X, are said to be uncorrelated if the 
nondiagonal elements of the covariance matrix are zero. 
The nondimensional correlation characteristic between the random 
variables XY; and X;, is the correlation coefficent 
tier Liles 
GF oS" 
VD[X,]D[X;] 


The correlation coefficients form the normalized covariance matrix 


1 rio Vis Tin 

ro, 1 lag lon 
Iris =|/fs1 rag 1 vt Fon ])s 

ray rae lng ] 


in which ‘ij = ry. 
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The continuous random variables ¥,, Xo,..., Xn forming a system are 
called independent if 


S(%1; X25 ++ +5 Xa) = far) fol%e): - Fl Kade 


and are called dependent if 


Sr, X25 ++ +5 Xn) # fil%1)fo(X2)- : S(Xn)s 


where /{(x;) is the probability density of the random variable X; (see Section 20). 
The discrete random variables X,, X2,..., X, are said to be independent if 


P(X, = hh, Xo = lo, sey Ay = in) = P(X, = i,)P(X, ae ig): : PCY, = In) 


SOLUTION FOR TYPICAL EXAMPLES 


Example 18.1 As a result of a test, an item can be classified as first grade 
with the probability p,, second grade with the probability p, or defective with 
the probability ps = 1 — p, — po. A number of » items are tested. Determine 
the probability density for different numbers of items of first and second grade, 
their expectations, variances and covariances. 


SOLUTION. Let XY denote the number of items of first grade and Y, of 
second grade. Since the tests are independent, the probability that k items will 
be classified as first grade, s items as second grade and the remaining n — k — s 
items as defective (taking into account all the possible combinations of the 
three terms k, s and m — k — s of which the sum is composed) is 

ni n-~k-Ss§ 


niko oe , 
Pit pot ps = 1. 


The values of this probability for k = 0,1,...,n, s=0,1,..., and 
k + s <n form the required set of probabilities for different numbers of items 
of first and second grade. The expectation of the number of first grade items is 


P(Y¥ =k, Y=s)= 


ho ee 
M[X] = aD > aE eae eae a eT 
Ps) n n-k n! a, 
rae 2, & Rae erates} 
7] 
= Papp. (Ps + Pa + Pa)” = mpi(Pr + Pa + Pa)" * = MPs. 
The variance of the number of first grade items is 
n n-k t 
D[X] = | ee eet ee k pS pt-k-s _ 72 
[*] 2 Ps kist(q.—k — sji?1P2?s x 


é SM n! m—-k-s y2 
= a a pe SE Se aD @ 
raed > 2 Fa en ae sy PEP a PS } 
d 7 
Pia. {mp,(p1 + Po + ps)" *} — ¥? 
Pi 


1 


mp, + n(n — 1)p? — n2p? = mpi] — Pi). 
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Similarly, we find that 
M[Y] =np2,  D[Y] = mp.(1 — ps). 


The covariance between the number of first grade and second grade items 
is 


LZ ni 
k,. poe ks sie eal: Se xy 
‘ 2 Ey aT Ey Pines y 
a 
= Pi 7? 2 {(pPi + Po + pa)"} — n? pipe 


= Pi a {np2(Pi + po + Pa)" *} — n*p\ po 
= n(n — 1)pip2 — n’pip2 = —Npipe. 


Example 18.2 For the probability density of a system of random variables 
(X, Y): 


I(x, y) = 0.5 sin (x + y) (o<x<3,0<y<3), 


determine (a) the distribution function of the system, (b) the expectations of 
X and Y, (c) the covariance matrix. 


SOLUTION. We first find the distribution function (for 0 < x < 7/2 and 
0<y< 7/2): 


bo y 
Fa SPY <ey e5) = i { Ossi ay aeay 
0 0 
= 0.5[sin x + siny — sin (x + y)]. 


The expectation of the random variable X is 
nI2 pr/2 . 
MX] = 0.5 { i x sin (x + y) dx dy 
19) 0 


ni2 T 7 
= 05 [ x | -¢os (x +5) + cos x] dx = — = 0.785, 
é 2 4 


The variance of X is 


54 
pix] = 0.5 [ x? sin (x + ») dx dy — 7 
ar? 


— 2) — oe,’ sage 
=05[" ca cos (x + 5) + cos x] dx 16 


mot 
2 7—~2=0.188. 
=7e+3 188 


From the symmetry of the probability density about X and Y, it follows 


that 
M[Y]=M[X],  D[Y] = DX]. 
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N FIGURE 15 


The covariance is 


72 


m/2 prj 
ky = 05 | ( xy sin (x + y) dx dy — 7 
0 0 


m2 : 7 ; 7 7 a 
= 0.5 | x| sin (x + 4 — sinx — 3 COS (x + 5) dx — Ié 


2 


7 7 
Nias I — 76 = — 0.046. 
Therefore, the covariance matrix has the form 
0.188 —0.046 
[kill = 
— 0.046 0.188 








In a similar way Problems 18.18 and 18.19 can be solved. 


Example 18.3. A needle of length / is dropped on a smooth table ruled 
with equidistant parallel lines at distance L apart. Determine the probability 
that the needle will cross one of the lines if / < L (Buffon’s problem). 


SOLUTION. Introduce a system of random variables (XY, ®), where X is 
the distance from the midpoint of the needle to the nearest line and ©® is the 
acute angle made by the needle with this line (Figure 15). Obviously, XY can 
assume all values from 0 to L/2, and ® from 0 to 7/2 with equal probability. 
Therefore, f(x, p) = 2/L-2/7 = 4/a7L for0 < x < L/2,0 < 9 < a2. 

The needle will cross one of the lines for a given 9 if 0 < x < (/sin ¢)/2. 
From this, it follows that 


4 m{2 l sin 0/2 3] 


Similarly one can solve Problems 18.20 and 18.21. 


PROBLEMS 


18.1 The coordinates X, Y of a randomly selected point are 
uniformly distributed over a rectangle bounded by the abscissas x = a, 
x =b and the ordinates y=c, y=d (b>a, d>c). Find the 
probability density and the distribution function of the random 


variables (X, Y). 


18. 


DISTRIBUTION LAWS 


18.2. A system of random variables (X, Y) has the probability 


density 
A 


LOY = BIST AOS +) 


Determine (a) the magnitude of A, (b) the distribution function 
F(x, y). 

18.3 Determine the probability density of a system of three 
positive random variables (X, Y, Z) if their distribution function is 


F(x, y,z) = —e7*)1 — ee) — ee?) (x 20,» 20,22 0). 


18.4 Under the assumptions of the preceding problem, find the 
locus of points with the same probability density 


S(x,y, Z) = fo, to < abc. 


18.5 From a sample of n = 6items, X turn out to be nondefective 
and of these Y (Y < 3) are of excellent quality. The system (X, Y) is 
given by the following two-dimensional probability distribution table 
(matrix) (Table 7): 

(a) Form the distribution function; (b) find the probability of ob- 
taining at least two items of excellent quality; (c) find M[X], M[ Y] and 
the covariance matrix. 


TABLE 7 
P(Y¥ = 7, Y=j) 










t 
~ 0 6 
0.202 0.062 0.049 0.004 
0 0.040 0.031 0.020 0.006 


0.025 0.018 
0.001 | 0.002 





18.6 A system of independent random variables X,, X2,..., Xn 
is given by the probability densities f(x), fo(%2), . - -> fn(x,). Determine 
the distribution function of this system. 

18.7 The probability density of a system of two random variables 
X, and XY, that can be measured only simultaneously is /(x,, x2). The 
values uw and v are observed. Find the probability that uw will be the 
value of the random variable X, and v that of Xo. 

18.8 Assume that the probability density for a system of three 
random variables that can be measured only simultaneously is 
S(%1, Xe, Xg). The values of u, v, w are observed, but it is not known how 
these values and the random variables correspond. Determine the 
probability that u is the realization of X, and w that of X3. 

18.9 Find the probability that a randomly selected point is located 
in the shaded region shown in Figure 16 if the distribution function 


F(x, y) is known. 
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FIGURE 16 





18.10 What is the probability that a point with coordinates 
(X, Y) hits a region specified by the inequalities(1 < x < 2,1 < y < 2) 
if the distribution function (a > 0) 


ee x? _ g-9v? 4 g-*?-2v? for x 20, y 20, 


fo) = for x <0Oory <0? 


18.11 The coordinates of a random point (X, Y) are uniformly 
distributed over a rectangle bounded by the abscissas 0 and a and 
ordinates 0 and b. Find the probability that a random point hits a 
circle of radius Rif a > b and the center of the circle coincides with the 
origin of the coordinates. 

18.12 The probability density of a system of random variables is 


f(x,y) = c(R — Vx? + y?) for x2 + y? < R?. 

Find (a) the constant c, (b) the probability of hitting a circle of 
radius a < R if the centers of both circles coincide with the origin. 

18.13 The random variables X and Y are related by the equality 
mX + nY = c, in which m, n and ¢ are constants (m 4 0, # 0). 

Find (a) the correlation coefficient r,,, (b) the quotient of the 
mean-square deviations a,,/c,. 

18.14 Prove that the absolute value of the correlation coefficient 
does not exceed one. 

18.15 Show that 


Kxy2 = M[(X — x(¥ — y(Z — 2)) 
= M[XYZ] — xkys — kee — Zkyy — RVZ. 


18.16 Suppose that -the covariance matrix of a system of random 
variables (X,, Xo, X3) is 


16 —14 12 
12 —-21 36 


Form the normalized covariance matrix ||r;;\\. 

18.17 Some items are classified by their shape as round or oval 
and by their weight as light or heavy. The probabilities that a randomly 
selected item will be round and light, oval and light, round and heavy 
or oval and heavy are a, 8, y and 6 = 1 — « — B — a, respectively. 
Find the expectations and variances for the number X of round items 
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and Y of light items, and also the covariance k,,, between the number of 
round items and light items if « = 0.40, 8 = 0.05. y = 0.10. 

18.18 Determine the expectations and the covariance matrix of a 
system of random variables (Y, Y) if the probability density is 


2 
f(x,y) = Ae 
18.19 Find the probability density, the expectation and the co- 
variance matrix of a system of random variables (X, Y) defined on the 
intervals (0 < x < w/2) and (0 < y < =/2) if the distribution function 
of the system is 
F(x, y) = sin x sin y. 


18.20 Solve Buffon’s problem; i.e., find the probability that the 
needle will cross at least one of the lines, in the case / > L (see Example 
18.3). 

18.21 A needle of length /is dropped on a plane partitioned into 
rectangles with sides a and b. Determine the probability that the needle 
will cross at least one side of a rectangle if a < /,b < I. 


19. THE NORMAL DISTRIBUTION LAW IN THE PLANE AND 
IN SPACE. THE MULTIDIMENSIONAL NORMAL 
DISTRIBUTION 


Basic Formulas 


The probability density of a system of two normal random variables (X, Y) 
is (for a normal distribution of the coordinates of a point in the plane) 


1 
x, y) = ——— 
1») Qr0,0yV | —r? 
! (x — x)? — 2rex — xX\y—¥) , (Y-— YY 
. exp { 21 <5 | oe Oxy aaaacey |} 
where xX, y are the expectations of X and Y; c,, o, are the mean-square devia- 
tions and r is the correlation coefficient of XY with Y. 
The locus of points with equal probability density is an ellipse (dispersion 
ellipse) defined by the equation 
(x= 3? xe - HY -D) | W- FP _ ys 
2 2 = . 
Ox OxSy oy 
If r = 0, then the symmetry axes of the dispersion ellipse are parallel to 
the coordinate axes Ox and Oy, the random variables X and Y are uncorrelated 
and independent and the probability density is 


f(y) = exp { -3 [a= - 2s + (y — =o) 


2700 y Ox Oy 


2 +\2 =\2 
Pp _ 2 (x — x) (y — ¥) |}. 
wE,E, exp { | i ea 





l 
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where E, = 0,pV2, E, = o,pV2 are the mean deviations of XY and Y, re- 
spectively, and p = 0.4769.... 
The ellipse defined by the equality 


(x x)? (y yy? 
E? E? : q 
is called the unit ellipse. 


The probability density of a system of n normal random variables (for a 
multidimensional normal! distribution) is 


] . 
Po X05) = aR OP {3D MMH — ANG) — 3b, 


i,jg=l1 
where 


ki Kyo Kin 
A = kay kos Kan 
Kat kno ea) Kew 


is the determinant formed by the elements of the covariance matrix; k{;) are 
the elements of the inverse matrix, 
5 1 ] 
Ki = 4 Ant =i 
and A,, is the cofactor of the element k;;. 
In the case of three independent normal random variables X, Y, Z, we 
have k,. = ky, = kx, = 0 and 


Ai;; 


fl. 9.) = gow exp {-} [aE , Vow, G2) 


Oy a2 Oz 
3 —\2 G\2 s\2 
ee: _2f/e-)? , o-y) cl}. 
7 : exp { ia °° EB 


where E,, E,, E, are the mean deviations of X, Y, Z, respectively. 
This is a particular case where the symmetry axes of the ellipsoid are 
parallel to the coordinate axes Ox, Oy and Oz. 


SOLUTION FOR TYPICAL EXAMPLES 
Example 19.1 Given the covariance matrix of a system of four normal 
random variables (X1, X2, X3, X4), 
15 3 1 0 


—2 
I|k:5|| = 


_ 
a 
_ Da 
— 
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determine the probability density f(x, x2, X3, X4) if ¥) = 10, X, = 0, % = —10, 
X4 = 1. 


SOLUTION. We first compute the cofactors of the determinant A = Rane 


16 36-22 a: 6 <= 
Ay = 6 4 1|=28; AG=e—fa AL 1273: 
= 3 3 0 1 3 
3 16 —-2 3 16 6 
Aw 1 6 - 16; AS t- S 4SeTe 
0: 0%. 3 io i 
15 0 Is 3 0 
Asse 1 4 J Ao =-|1 6 1) =—291; 
0 1 3 (2° 3 
115 3 J 15 3 
Aay = 1 6 | 05 Asy = |3 16 —2| = 633; 
Ss 4 O95 34 
5 3) is 3] 
Aw =—-| 3 16 6|=-405;  Ag= |3 16 6] = 404. 
Oo 4 1 6 4 


Next, we find the value of the determinant: 


is S 4. 
an Pe ee 5A FAs eA 397 
= 1 6 4 1 rs 11 12 13 — s 


0 -2 I 3 


In deriving the formula for the probability density, we take into account 
the fact that for 7 # j, the exponent contains equal terms 


kiy Pa — Xi) Oy — *) = Ki Pe; — X04 — X)). 
The probability density is 


1 1 
ST (X1, Xa, Xa, X4) = 4y2/ 307 exp {759 [28(x, — 10)? — 26(x, — 10)x, 


+ 32(x, — 10)(%3 + 10) — 28(x, — 10) 
x (x, — 1) + 162x3 — 582x.(x3 + 10) 
+ 410x2(x, — 1) + 633(%3 + 10)? 


~ 810(x, + 10)\(x, — 1) + 404(x, — Male 
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Example 19.2 A random point in space is given by three rectangular 
coordinates forming a system of normal random variables with the probability 
density 


I(x, y, Z) = me exp {3 [2x? + 4y? — 2yp(z+ 5) 4+ (+ sy}. 


(a) Find the covariance matrix, (b) determine the locus of points when the 
probability is 0.01. 


SOLUTION. (a) Since 


I(x; ys z) i AAO; z) ’ 











where 
x? 
fie) = ex exp {—7}. 
= lf 2 _ ers), & 4] 
SAY, 2) = cx exp {— 3 [>? - Sg ge 
then 
Ky = Kuz = 0 
This implies that 
l 4 
DIX}=or=2; DIY]=o =; DIZ) =o =7—,: 
r = T: = Kye = 1 = 4 
a o(1 — r?) 4’ a Et ee a Kye 3? 
2 0 0 
4 4 
Iki =| 3 3 
4 16 
1° 3 3) 


For verification, we can compute the normalization factor 
i Nn Ss eats ge 
(2n)2VA  8/2.2V2.V32 «16079? 
(b) The required locus of points with constant probability density is the 
surface of the ellipsoid 
1673/2 


2x? + 4y? — 2yp(z + 5) + (Z + 5)? = —8 In — H-; 
x y y( eee ) TE 


Example 19.3 Find the probability that a point (X¥, Y,Z) lands in a 
region representing a hollow parallelepiped whose outer surface is given by the 
planes 

x=a, x=b, yeu, y=d, z=m, Z=M, 
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and whose inner surface is given by the planes 
X= G2, xX=be, Yl, Y=dg, Z= Mg, Z= Ng 
(b; > ai, d, > Ci, ni; > ™m;, i= Like 


The dispersion of points (X, Y, Z) obeys a normal distribution with the 
principal axes parallel to the coordinate axes, the dispersion center at the 
point X, y, Z and mean deviations E,,, E,, E,. 


SOLUTION. Since the principal dispersion axes are parallel to the coordinate 
axes, the event that one of the coordinates, for instance x, will assume values 
on the interval (a, 6) is independent of the values assumed by the other co- 
ordinates. Therefore, 


Pa<x<bc<y<dm<z<¢n) 
=Pa<x<b)P(c<y <d)P(m<z<n), 


Pla <x <b) =5 [a(- E) - o(? z) 


The probabilities of the other inequalities can be determined similarly. 

The required probability of reaching the interior of the hollow parallelepiped 
will be determined as the difference between the probabilities of reaching the 
parallelepipeds bounded by the outer and inner surfaces; i.e., 


rH foe) ENE) (254) 
«(oe 2) — af) [eZ ) - 9) 
«(o(e2) - =A] [o() - 9% -)} 


PROBLEMS 


in which 





























19.1 It is known that XY and Y are independent normal random 
variables with expectations x and y and mean deviations E, and E,, 
respectively. Express the distribution function of the system (X, Y) in 
terms of the normalized Laplace functions. 

19.2 Given the expectations of two normal random variables 
M[X] = 26, M[Y] = —12, and their covariance matrix, 


196 —91 
—91 169 


determine the probability density of the system (X, Y). 
19.3. Given the probability density for the coordinates of a ran- 
dom point in the plane, 


f(x,y) = cexp {—[4(x — 5)? + 2@ — 5)(y — 3) + S(y — 3), 


> 


iol = | 
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find (a) constant c, (b) the covariance matrix, (c) the area S,, of the unit 
ellipse. 

19.4 Determine at the point x, = 2, x2 = 2 the probability 
density of a system of two normal random variables for which 
X, = X2 = Oand 


1 
Ikul = . |: 


19.5 Given the covariance matrix of a system of three normal 
random variables (X, Y, Z), 


—2 3 8 


and expectations x = y = Z = Q, find the probability density f(x, y, z) 
and its maximum value. 

19.6 A system of m normal random variables has the covariance 
matrix 


eet 
_ 
ie) 
Ww NY 
Ww NH 


| 2 3 ++» n—-2 n-2 n-2 
1 2 3 n—-2 n-1 n—-1 
1 2 3 n-2 n-1 n 


(a) Compute the inverse of this matrix; (b) find the probability 
POC ise cn ye) AE ee — Se, = 0: 

19.7 The coordinates (X,, Y,) and (X,, Y.) of two random points 
in the plane obey the normal distribution law with the expectations of 
all coordinates zero and the variances of all coordinates equal to 10. 
The covariances between coordinates with the same symbol are equal: 
MLX,X.2] = M[Y, Y.] = 2; the remaining pairs of coordinates are un- 
correlated. Find the probability density f(x1, yi, Xe, Ye). 

19.8 The coordinates (XY, Y) of a random point A in the plane 
obey the normal law 


Determine the probability that A will turn out to be inside an ellipse 
with principal semi-axes ka and kb and coinciding with the coordinate 
axes Ox and Oy. 
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19.9 The coordinates (Y, Y, Z) of a random point A in space 
obey the normal distribution law 


ere Pee = (= 5 a Z) : 
S(%, ys Z) = WIE E,Es exp { c EF? = E23 au ES 


Find the probability that A is inside an ellipsoid with the principal 
semi-axes KE,, KE, and kE,; coinciding with the coordinate axes Ox, 
Oy and Oz, 

19.10 The determination of the coordinates of a point in the 
plane is accompanied by a systematic error d in one of its rectangular 
coordinates and a random error obeying a circular normal distribution 
with mean deviation £. Find the probability that the deviation of the 
point from its measured position will not exceed a quantity R. 

19.11 A system of random variables (XY, Y) obeys a normal 
distribution with numerical characteristics M[X] = M[Y] = 0, 
E,, = Ey, = 10, k,, = 0. Determine the probability that (a) X¥ < Y, 
(b) ¥>0, Y <0. 

19.12 Compute the probability that a random point A with 
coordinates X, Y and obeying a normal distribution law will lie in a 
rectangle whose sides are parallel to the principal dispersion axes if the 
coordinates of its vertices are (a, b), (a, d), (c, b), (c,d) for a = —5, 
b = 10, c = 5, d = 20, and x = 0, y = 10, EF, = 20, E, = 10. 

19.13. A random point is distributed in accordance with a normal 
circular law with mean deviation E = 10 m. Compare the probability 
of hitting a figure whose area is 314 sq. m. if its shape is (a) a circle, 
(b) a square, (c) a rectangle whose sides are in the ratio 10:1. The 
dispersion center coincides with the geometric center of this figure. 

19.14 Find the probability that a randomly selected point lies 
inside the shaded region (Figure 17) bounded by three concentric 
circles and the rays issuing from their common center if the radius of 
the exterior circle is R, and the dispersion of the point in the plane obeys 
a circular normal distribution law with mean deviation E. The disper- 
sion center coincides with the center of the circles. 

19.15 Find the probability of hitting a figure bounded by the 
arcs determined by the radii R, and R, and the rays issuing from the 













FIGURE 17 
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common center O if the dispersion of a random point in the plane 
obeys a circular normal distribution with mean deviation £, and the 
angle made by the rays is a. The dispersion center coincides with M 
(R, < Ro). 

19.16 The probability of hitting a rectangle with sides 2d and 2k 
and parallel to the principal dispersion axes satisfies the following 


approximate formula: 


nes (8a) Cee re ye 














4 
pe _ 2(* =) 
A © exp { p(s + ; 


which is recommended when d/E,. and k/E, do not exceed 1.5. Equating 
the zero and second moments on the left- and right-hand sides of this 


equality, find the values of A, a, f. 

19.17 Using the approximate formula from the preceding prob- 
lem, find the probability of hitting a rectangle with sides 2d and 2k 
parallel to the principal dispersion axes if the coordinates of the dis- 
persion center are uniformly distributed over the given rectangle and 
E,, E, are known. Compare the result obtained with the probability 
of a direct hit in the same region when the center of dispersion coincides 
with the center of the region. 

19.18 A target consists of four concentric circles of radii 10, 20, 
30 and 40 cm., respectively (Figure 18). By hitting the bull’s-eye one 
scores 5 points, and for each of the three annuli—4, 3, and 2 points. 
The score is satisfactory if one scores at least 7 points in three shots, 
and excellent if one scores more than 12 points. What is the probability 
of a satisfactory score in the case of circular normal dispersion with 
mean deviation 20 cm.? What is the probability of an excellent score? 
The dispersion center coincides with the center of the target. 

19.19 What is the probability of hitting a right triangle ABC with 
legs BC =a and AC = 5b parallel to the principal dispersion axes 
(AC || Oy), (BC || Ox) if the dispersion center coincides with point A 


and 


2 


a b 
— = —-=k? 
ia k 1 


J1!Z] FIGURE 18 
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19.20 Find the probability that a point with coordinates X, Y, Z 
will hit a region representing a sphere of radius R, from which a central 
cube with edge a has been removed (the diagonal of the cube is shorter 
than the diameter of the sphere). The dispersion center coincides with 
the common center of the sphere and the cube. The distribution is 
normal spherical with mean deviation E. 

19.21. Find the probability that a point A(X, Y, Z) will lie inside 
a right cylinder whose base has radius R, and whose height is / if the 
dispersion in the xy-plane parallel to the base obeys a normal! circular 
distribution with mean deviation F, and the dispersion along the 
generator is independent of XY, Y and obeys (a) a normal distribution 
with mean deviation B (the dispersion center is located on the axis of 
the cylinder and divides it in the ratio m:n), (b) a uniform distribution 
over the interval (— H, H) for H > h, 

19.22 Find the probability that a random point A(X, Y, Z) will 
lie in a right circular cone whose vertex coincides with the dispersion 
center, whose height is # and whose base has radius R; the dispersion 
in the xy-plane, which is parallel to the base, obeys a normal circular 
law with mean deviation £, and the dispersion along the height is 
independent of X, Y and obeys a normal distribution with mean 
deviation a. 

19.23 A normal distribution law in the plane is given by the 
expectations of random variables x, = X. = 10 and the covariance 
matrix 


Jk = 








36 —18 
=18 251 


Find the locus of points with probability density 107°. 
19.24 A normal distribution law in space is given by the 


expectations ¥, = 2, X, = 0, X¥,3 = —2 and the covariance matrix 
4 0 -1 
Kish = 0 4 0}. 
—1 0 4 


Find the locus of points whose probability density is 107°. 

19.25 For the multidimensional normal! distribution given in 
Problem 19.6, find the locus of points with probability density 107°. 
Find the value of n, for which this problem has no solutions. 


20. DISTRIBUTION LAWS OF SUBSYSTEMS OF 


CONTINUOUS RANDOM VARIABLES AND 
CONDITIONAL DISTRIBUTION LAWS 


Basic Formulas 


99 


If F(x, y) is the distribution function of a system of two random variables, 
then the distribution function of the random variable Y is 


F(x) = F(x, 0) = le. | © fs y) dy dx. 
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Similarly, the distribution function of Y is 


FO) = F=f" [se rdeay. 


The probability densities of the random variables contained in the system 
are 


fax) = [fos vd dy, 


Ky) = | fos vax. 


If F(x, X2,...; X,) is the distribution function of a system of n random 
variables, then the distribution function of some of these variables (subsystems 
of random variables), for example, X,, X2,..., X;, iS 


Fy 2, «(X15 XQo-+65 Xx) = F(x, Xa,-- +9 Xk» oO, tees 0), 


and the corresponding probability density is 


loo} foo} 
Si, 2, ope (%15 Xap gy) = | an | POG asses Gy) AX 41 °°* AX. 
-o —- 2 


The probability density of one of two random variables, computed under 
the assumption that the other random variable assumes a certain value (the 
conditional probability density), is 








fx] y) = Le), fo|»= te. 


The probability density of the subsystem of the random variables (Xj, Xo, 
..+, X,), computed under the assumption that the remaining random variables 
Xitis Xeg4o.---, Xpq assume certain values, is 


POG Maps ie XG) 
Ny Kees Xe sie Xa) = FY? 
I 1s X25 +y Xe | Heese Meta + -» Xn) ict ry ecun(Xnt as +++» Xn) 


The probability density of a system can be expressed in terms of the 
conditional densities by the formula 


I Xin Mig Magic, XG) = fi(%1) fo(x2 | x1) f3(Xs | X41, Xq).- Sin | 2 ne en 


SOLUTION FOR TYPICAL EXAMPLES 


Example 20.1 The position of a random point A(X, Y) is equally probable 
at any point of an ellipse with the principal semi-axes a and b coinciding with 
the coordinate axes Ox and Oy, respectively. 

(a) Determine the probability density of each of the two rectangular 
coordinates and their mutual conditional probability densities, (b) analyze the 
dependence and the correlation of the random variable forming the system. 
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SOLUTION. (a) Since 


iS) 
NS 


for 


83] bad 
+ 
BIS 
iS) 

IN 


1 
nab 
I(x, y) = 


OS 


0 for Stl, 


for a given x on the interval (—a, a), the probability density f(x, y) differs from 
zero only if —bV1 — x2/a? < y < bV1 — x?/a?; this implies that 





x 

fice 

FC) = bvi-(?ja2) dy ‘| a? 
is ax ov 1 = (x2/a2) mab 7a 


For |x| > a, f(x) = 0. From this we obtain 








1 x2 
»fi-% for |x| <a, |y| <b ie} 











2 
f(y |= 7 
x? 
0 for |x| >a or |y| > 5 ee 
Similarly, 
2 y? 
Om ee y <b, 
l y? 
f(x |») = —=——= for |y| <b, |x| <a f/l1—-G 
y b 


and 





FAY) =f(x|¥) = 0 for |y| > 6 or Ix] > a1 — 3. 


(b) The covariance between X and Y is 


Ky = f f xyf(x, y) dx dy, 


where the function integrated is different from zero inside the ellipse 
x? y? 
Zz + B= 1. 
Making the change of variables 
xX = arcos@, y = orsing, 


we obtain 


2n 1 , 1 
ky = [ i, arbr cos @ sin ar abr dr dp = 0. 
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Thus, the random variables X and Y are uncorrelated (k,., = 0) but 
dependent, since 


FAO)LY) # LG ¥). 
Example 20.2. The coordinates of a random point in the plane obey the 
normal distribution law 
ee eee 
Qo,0,V1 — r? 


x onp {a bog [EMF _ We 20 =D, Y= 


2 
O71 9192 a2 


I(x, y) = 


Determine (a) the probability density of the coordinates X and Y, (b) the 
conditional densities f(y | x) and f(x | y), (c) the conditional expectations, 
(d) the conditional variances. 


SOLUTION. (a) For the probability density of the coordinate X, we find 


fax) = f° fx, ») dy. 


Making the change of variables 








xXx—X = y-—y Sui 
O71 , o2 
and considering the fact that 
1 P 2 .g , (v— my 
mee — 2ruv + v7] =u oan greaer ae) 


we obtain 


SAX) = exp (3) = i= exp {- es oa dv 


{-3} 
are ——=>p? 
Re aD 





or 





Similarly we find that 


Ho) = ee exp {-U Ph. 


(b) Dividing f(x, y) by f(x), we obtain 





= 02 = a 

; Jy -5-r2@-2] 

= exp ¢ — 
o,V 2a VI — Pr? 2(1 — r?)o3 





Sy |» = 
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and similarly 
= Oy = 2 
\ [x-#-r20- 
fey) a, V 2a V1 — r? [ 2(1 — r?)ot 


(c) From the expressions for conditional probability densities, it follows 
that the conditional expectation of the random variable Y for a fixed value 
X = xis 


ye M[Y| x] =y+r2(x— 3). 
1 
Similarly 


Xy 


I 


MX | y] = 8+ r= (y— J). 


These equations expressing the linear dependence of the conditional 
expectation of one of the random variables on a fixed value of the other variable 
are called the regression equations. 

(d) From the expressions for conditional distribution densities, it follows 
that the conditional variances are 


D[Y | x] = Gay = at(1 = r*), 
D[X | y] = a2), = o3(1 — r?). 


Example 20.3 Determine the probability density of the length of a radius- 
vector if the coordinates of its end A obey the normal circular distribution law 





ol x7 + y? 
fs, 9) = sag exe {- 7ai }. 


SOLUTION. We pass now from the rectangular coordinates of A to the 
polar coordinates (r, y). The probability that the radius-vector assumes values 
on the interval (r, r + dr) is approximately f(r) dr, and can be interpreted as 
the probability for a random point A to lie in an infinitely narrow annulus 
shown in Figure 19. 

Consequently, 


PA de= | | Gi idea, 


12 <x24+y2 <(rt+dr)2 


FIGURE 19 
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Integrating with respect to the variables r, p and considering the expression 
for f(x, y), we obtain 


ca r? r r? 
1) = |" ayaa ex? {— gpa} ae = Za exw {— sea} 


(Rayleigh’s distribution). 


PROBLEMS 


20.1 A system of random variables (XY, Y,Z) is uniformly 
distributed inside a rectangular parallelepiped determined by the 
planes x = a,,X = do, y = by, y = bo, Z = C1, Z = Cy. Find the proba- 
bility densities of the system (X, Y, Z), of the subsystem (Y, Z) and of 
the random variable Z. Verify the dependence of the random variables 
forming the system. 

20.2 The position of a random point (X, Y) is equally probable 
anywhere on a circle of radius R and whose center is at the origin. 
Determine the probability density and the distribution function of each 
of the rectangular coordinates. Are random variables X and Y 
dependent? 

20.3. Under the assumption made in the preceding problem, find 
the probability density f(y | x) for |x| < R, |x| = Rand |x| > R. 

20.4 Under the assumptions of Problem 20.2, compute the 
covariance matrix of the system of variables X¥ and Y. Are these 
variables correlated ? 

20.5 A system of random variables X, Y obeys a uniform distri- 
bution law over a square with side a. The diagonals of the square co- 
incide with the coordinate axes. 

(a) Find the probability density of the system (X, Y), (b) determine 
the probability density for each of the rectangular coordinates, (c) find 
the conditional probability densities, (d) compute the covariance 
matrix of the system of random variables (X, Y), (e) verify their 
dependence and correlation. 

20.6 The random variables (X, Y,Z) are uniformly distributed 
inside a sphere of radius R. Determine for points lying inside this sphere, 
the probability density of the coordinate Z and the conditional 
probability density f(x, y | z). 

20.7. Given the differential distribution law for a system of non- 
negative random variables 


I(%, y) = kxye"@?*™ — (x 2 0, y 2 0), 


determine k, f.(x), f(y), (x |v), f(y | x), and the first and second 
moments of the distribution. 

20.8 Given f,(y), M[X | y] and DLY | y] for a system of random 
variables (X, Y), find MLX] and D[X]. 


20. 
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20.9 A system of two random variables (XY, Y) obeys the normal 
distribution law 


I(x, y) = k exp {-oa [(< — 5)? + 0.8(% — 5) 


x (y + 2) + 0.25(y + 2A}}. 


Determine (a) the conditional expectations and variances, (b) the 
probability density of each of the random variables forming the system, 
(c) the conditional probability densities f(y | x) and f(x | y). 

20.10 The probability density of a system of two random variables 
(XY, Y) is given in the form 

xe = Ae re (a>0,c> 0). 

Find the distribution law f,(x) and f/,(y). Under what conditions 
are X and Y independent random variables? 

20.11 Given the probability density of a system of two random 
variables, 

JG ete Ota ee 


find the constant k, the covariance between X and Y, and the conditional 
distributions f(x | y) and f(y | x). 

20.12 The position of a reference point in the plane is distributed 
according to a normal law with x = 125 m., y = —30m., o, = 40 m., 
o, = 30m.andr,, = 0.6. The coordinate X defines the deviation of the 
reference point with respect to the “‘distance,” ie., with respect to a 
direction parallel to the observation line. The coordinate Y defines the 
deviation of the reference point with respect to a lateral ‘“‘direction”’ 
perpendicular to the observation line. The deviations are estimated from 
the origin of coordinates. 

Determine (a) the probability density of the deviations of the refer- 
ence point with respect to the distance, (b) the probability density of 
the deviations of the reference point with respect to the lateral direction, 
(c) the conditional probability density of the deviations of the reference 
point with respect to distance in absence of lateral deviations, (d) the 
conditional probability density of the deviations of the reference point 
with respect to lateral direction for a deviation with respect to the distance 
equal to +25 m. 

20.13 Under the assumptions of the preceding problem, find the 
regression equations of Yon X and X on Y. 

20.14 Determine the probability density of the length of the 
radius-vector for a random point and its expectation if the coordinates 
(X, Y, Z) of this point obey the normal distribution law 


1 1 
I(x, y, Z) = Baags oP {5 + yp? + 2. 


20.15 The coordinates of a random point A in the xy-plane obey 
the normal distribution law 


x? 


f(*%, y) = sagen {-5 (= + ale 
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Find the probability densities f(r) and f.(¢) for the polar co- 


ordinates of this point. 
20.16 Under the assumptions of the preceding problem, find the 
conditional probability densities f(r | p) and /(¢ | r). 
20.17 A random point in space obeys the normal distribution law 
1 x2 y? z2 
105162) = Gamage OP {-3 (Ze + a +B) 


Find (a) the probability density of the spherical coordinates of this 
point (R, ©, ®) if x =rcos cosy, y =rcos Osing, z = rsin 8, 
(b) the probability densities of the subsystems (R, ©) and (0, 9), 
(c) the conditional probability densities f(r | 9, p) and f(@ | r, 6). 

20.18 For the system of random variables X,, Yi, Xo, Yo 
of Problem 19.7, find the probability densities of the subsystems 


(a (x1, Xz) and yer (x1, yi): 
20.19 Under the assumptions of the preceding problem, determine 
the probability density f(x2, yo | x1, yi), the conditional expectations 


and the conditional variances 
MX, | x1, Vi], MY. | x1, yi), DX, | X1,¥i), DY. | X1, yi) 


for xy = 0, yi = 10. 


IV NUMERICAL CHARACTERISTICS 
AND DISTRIBUTION LAWS OF 
FUNCTIONS OF RANDOM 
VARIABLES 


21. NUMERICAL CHARACTERISTICS OF FUNCTIONS OF 
RANDOM VARIABLES 


Basic Formulas 


The expectation and variance of a random variable Y that is a given 
function, Y = p(X), of a random variable X¥ whose probability density f(x) is 
known, is given by the formulas 


F=MIY] = |" of) de, 


DIY] = [lof dx — 7 


In a similar way, one may find the moments and central moments of any 
order: 


mY] = |" feo) de, 


ml Y1= |" f@)- IO dx, k= 1,2... 


The foregoing formulas extend to any number of random arguments; if 
Y = P(X, Xa, ry X,); then 


mel] = [oof bolts X25. o5 IPCs Xap oy Hy) ey dy 


-@ ({(n) —-@ 
LY] = J ha | [p@a, Xay.. +5 Xn) — YI, XQ, ++ +5 Xn) dx, +++ dx,, 
-@ (n) -@ 
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where f(x), X2,...,X,) is the probability density of the system of random 
variables (X,, Xo,..., Xn). 

For discrete random variables, the integrals in the preceding formulas are 
replaced by sums, and the densities by probabilities of the corresponding sets 
of values of X,, Xo,..., X>. 

If the function p(X, Xo,..., X;,) 1s linear; that is, 


Y = > a,X; + b, 
f=1 
then 
M[Y] = 2. a,;M[X,] + 6, 
j= 


D[Y] = a a;D[X;] + 2 Pa a,a,k;;, 


where k;,; is the covariance between the random variables X; and X;. 
Knowledge of the distribution law of the random arguments for the 
determination of the moments of the function is unnecessary in some cases. 
Let Z = XY, then M[Z] = M[X|M[Y] + &,,.,. Furthermore, if XY and Y are 
uncorrelated, i.e., the covariance k,., vanishes, then 
D[Z] = D[X]D[Y] + x*D[Y] + y°D[X], 
M[Z] = M[X]M[Y}]. 
The last formula can be generalized for any number of independent random 
variables: 
j=1 j=l1 


If the moments of the linear function 
Y= > aX);+6 
j=1 


of independent random variables exist, they can be determined by the formula 


Ld* z 
m[ Y] = TE ee i, E,,(a;t)|:=05 cS 1, 2, oeehaty 


where E,,,(t) = Ge F,(x)e"* dx is the characteristic function of the random 
variable X;,. 

The asymmetry coefficient and the excess of the random variable Y in this 
case are given by the formulas 


where #5(t) = In {em i Ex,(a,t)}. 





SOLUTION FOR TYPICAL EXAMPLES 


Example 21.1 A random variable X obeys a binomial distribution law. 
Find the expectation and variance of the random variable Y = e*. 
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SOLUTION. The random variable XY can assume values 0, 1, 2,..., 7. The 
probability that it will assume the value m is determined by the formula 
Pisce = Ciytg™ *. 

Therefore, 


Ma 


M[Y] = 2 YmPam = 2 eomCuprg”-™ = (q + pee)’; 


m=0 


n 


DIY] = 3 vaPam— P= > CHpemyrgr-™ — 5? 


m=0 


(q + pe)" — (q + pe?) 


Example 21.2 The screen of a navigational radar station represents a 
circle of radius a. As a result of noise, a spot may appear with its center at any 
point of the circle. Find the expectation and variance of the distance between the 
center of the spot and the center of the circle. 


SOLUTION. The random distance R from the center of the circle to the spot 
can be expressed in terms of rectangular coordinates X¥ and Y as 


R= VX? + Y? 


The probability density of the system of random variables (X, Y) is known 
and is given by the formula 


ees 2 2< g2 
One for x7 + y* < a’, 
0 for x? + y? > a’. 
Therefore, 


eee 22 a 
M[R] =<, I VEEP dee dy = <5 | dp | Pdr =a, 
fe x2 +y2 <a2 a 0 0 
La pagal ada tase 
DIR] = =a (hl (x? + y?) dx dy —? =e, dp ee dr ao = 


x2 +y2<a2 


In a manner similar to that used in Examples 21.1 and 21.2, one can solve 
Problems 21.1 to 21.14, 21.20 to 21.24, 21.26, 21.27, 21.29 and 21.30. 


Example 21.3 A sample of 7 items is drawn without replacement from a 
lot of N items, of which T = Np are defective. Find the expectation and variance 
of the number of defective items in the sample. 


SOLUTION. Let X denote the random number of defective items in the 
sample. 

The random variable X can be represented as X¥ = D7_, X;, where the 
random variable X, equals | if the jth item selected turns out to be defective, 
and zero otherwise. The probability is p that the value is 1 and, consequently, 
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xX, = M[X,] = 0-(1 — p) + |-p = p (as in Example 6.1, one can show that the 
probability of obtaining a defective item does not depend on /). 
Then 


Mix] = M[ Sx] = 3 MEX) = m. 


If sampling is done without replacement, the random variables X; are 
dependent and, hence, 


DLX] = D| x = $oixy+ 5 3%, 
t=1 i=l a ge 
where 
DLX,] = (1 — x)?p + 0 — x)? — p) = CU — p)?p + p72 — p) = pa, 
ki; = MIX; = XX; == x;)] = M[X,X5] _ {MLX,}}? 
Np — 1 Pq 
— = a et — p= eee eee, pe eR, eed ES 
= P(X, = P(X, = 11% = 1) - p? = pa P Wo 1 
Finally, 


D[x] = npa(1 — 5—4): 


Similarly one can solve Problems 21.15 to 21.17, 21.25 and 21.28. 


Example 21.4 Find the expectation for the square of the distance between 
two points selected at random on the boundary of a rectangle. 


SOLUTION. By selecting two random points on the boundary of a rect- 
angle, the following unique mutually exclusive events (hypotheses) may occur 
(see Figure 20): H, that the points lie on the same side a, H, that the points lie 
on the same side 6, Hg that the points lie on adjacent sides, H, that the points 
lie on opposite sides a, H; that the points lie on opposite sides b. 

For the probabilities of these hypotheses, we have 


aa a? 
rey (2-2) = 


P(H,) = (=>) a5 


where 2p is the perimeter of the rectangle. 
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FIGURE 20 > 2 


<—————— g ——___» 


Determine the conditional expectation (i.e., the expectation with the assump- 
tion that the hypothesis H; occurs) for the square of the distance between two 


points: : 
apa 1 apa a 

M[Z? | H,] = | [fee 2G = vy? ad dy = =| [ @- yr axa =F, 
oO 16) 0 16) 


] b b b2 
M[Z? | H.] = | i, (x — vy)? dx dy = ra 


a b 
MiZ?| Hol = = [- [3 + y%) dx dy = 3 @ + 0°), 


M[Z? | Hy) = Mis? + (X — YP} =e MX Y= eS, 
M[Zz? | Hs] = M[a? + (X¥ — Y)?] =@qr+ M[CX — YPJ=a? + ae 


We find that the total expectation of the random variable Z? is: 
5 
M[Z?] = > P(H)M[Z? | H,] = = (at + 40% + 6a°b® + 4ab? + b*) 
j= 
—_ (a+ b)* _ pr 
6p? «G 
Problems 21.18 and 21.19 can be solved similarly. 


PROBLEMS 


21.1 Find the expectation of the length of a chord joining a given 
point on a circle of radius a with an arbitrary point on the circle. 

21.2 Find the expectation of the length of a chord drawn in a circle 
of radius a, perpendicular to a chosen diameter and crossing it at an 
arbitrary point. 

21.3 Some steel balls are sorted according to their size so that 
the group with rated size 10 mm. contains balls that pass through a 
circular slot of 10.1 mm. and do not pass through a slot of diameter 
9.9 mm. The balls are made of steel with specific weight 7.8 g./cc. Find 
the expectation and variance of the weight of a ball belonging toa given 
group if the distribution of the radius in the tolerance range is uniform. 

21.4 A fixed point O is located at altitude 4 above the endpoint 
A of a horizontal segment AK of length /. A point B is randomly 
selected on AK. Find the expectation of the angle between segments 
OA and OB. 
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21.5 The legs of a compass, each 10 cm. long, make a random 
angle g, whose values are uniformly distributed over the interval 
[0, 180°]. Find the expectation of the distance between the ends of the legs. 

21.6 A random variable X obeys a normal distribution law. Find 
the expectation of the random variable Y if 

i eG 
See aeers aah 

21.7 The vertex C of the right angle of an isosceles right triangle 
is connected by a segment with an arbitrary point M on the base; the 
length of the base is 2. Find the expectation of the length of segment CM. 

21.8 A point is selected at random on a circumference of radius a. 
Find the expectation of the area of a square whose side equals the 


abscissa of this point. 

21.9 An urn contains white and black balls. The probability of 
drawing a white ball is p and drawing a black one, g. A number n of balls 
are drawn one by one with replacement. What is the expectation of the 
number of instances in which a white ball follows a black one? 

21.10 A system of random variables XY, Y obeys the norma! distri- 


bution law F : : 
fos 9) = Fa exp {pp = Eh 

Find the expectation of the random variable 

R= VX? 4 ¥?. 

21.11 Two points X and Y are randomly selected in a semi- 
circle of radius a. These points and one end of the bounding diameter 
form a triangle. What is the expectation of the area of this triangle? 

21.12 Three points A, Band C are placed at random ona circum- 
ference of unit radius. Find the expectation of the area of the triangle A BC. 

21.13 The number of cosmic particles reaching a given area in 
time ¢ obeys Poisson’s law 

Pos (ar” e-at 
i m! ; 
The energy of a particle is a random variable characterized by a mean 
value w. Find the average energy gained by the area per unit time. 

21.14 An electronic system contains n elements. The probability 
of failure (damage) of the kth element is p,;. (kK = 1, 2,..., 7). Find the 
expectation of the number of damaged elements. 

21.15 A system consisting of » identical units stops operating if 
at least one unit fails, an event that occurs with equal probability for 
all the units. The probability that the system will stop during a 
given cycle is p. A new cycle starts after the preceding one has been 
completed or, if the preceding cycle has not been completed, after the 
damaged unit has been repaired. Find the expectation of the number of 
units subject to repairs at least once during m cycles. 

21.16 There are 7 units operating independently of each other, 
and carrying out a series of consecutive cycles. The probability of failure 
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for any unit during one cycle is p. A new cycle starts after the preceding 
one is completed (separately for each unit), or after repairs if the 
preceding cycle is not completed. Find the probability of the number of 
units subject to repairs at least once if each unit operates for m cycles. 

21.17 In an electronic device the number of elements failing to 
operate during some time interval obeys Poisson’s law with parameter a. 
The duration ¢,, of repairs depends on the number m of damaged ele- 
ments and is given by ¢,, = T(1 — e~°%”). Find the expectation of the 
duration of repairs and the loss caused by delay if the loss is propor- 
tional to the square of the duration of repairs: S,, = kt2. 

21.18 A system has 1 units operating independently. If at least 
one unit fails, the system will stop. The probability of occurrence of this 
event is p and the failures of all units are equally probable. A new cycle 
starts after the completion of the preceding one or after the damaged 
unit has been repaired if the preceding cycle has not been completed. 

The system must run 2m cycles and, moreover, after the first m 
cycles (m < n/2), all the units subject to repairs at least once are dis- 
carded and a number m of cycles are repeated with the remaining units 
under the previous conditions. Find the expectation of the number of 
units repaired at least once after two series of m cycles each. 

21.19 A marksman fires two series of m shots each at n targets. 
The shots are fired successively at each target and the detailed results of 
each series of shots are not recorded. The bullet can strike, with proba- 
bility p, only the target aimed at by the marksman. A target is con- 
sidered hit if at least one bullet reaches it. The second series is fired after 
the targets hit in the first series are noted. The rules are the same as in 
the first series, except that shots are not fired at those targets hit in the 
first series. Find the expectation of the number of targets hit during the 
whole experiment form = m = 8 andn > 2m. 

21.20 Two points are selected at random on adjacent sides of a 
rectangle with sides a and b. Find the expectation of the distance 
between these two points. 

21.21 Find the expectation of the distance between two randomly 
selected points on opposite sides of a rectangle with sides a, b. 

21.22 Obtain the formulas for the expectation and variance of the 
number of occurrences of an event in n independent trials if the proba- 
bility for its realization varies from one trial to another and equals 

Py (A = 1,2,...,) at the kth trial. 

21.23 Ten weights are placed on a scale. The precision of manu- 
facture of each weight is characterized by a mean error of 0.1 g. The 
precision in the process of weighing is characterized by a mean error of 
0.02 g. Find the mean error in the determination of the mass of a body. 

21.24 Two points are taken at random on a segment of length I. 
Find the expectation and variance of the distance between them. 

21.25 The probability density of a system of random variables 
(X, Y) is specified by the formula 


Gay ee 


= eae 
fle, 9) = ee exp { 15{ 100 * 150 + ol} 
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Find the expectation and variance of the random variable 


Z=aX + bY. 
21.26 A random variable X obeys the normal distribution law 


P 2 = 
x) = = exp 4 —p? —5}- 
fe) = gps exp {—r* Fa 

Evaluate the expectation and variance of the random variable 
Y= |X|. 

21.27 A random variable X obeys Poisson’s law. Find the 
expectation and variance of the random variable Y = cos bX. 

21.28 The distance from a lighthouse is given as the arithmetic 
mean of three measurements. The relation between errors depends on 
the rate of measurements and is characterized by the following values 
of the correlation coefficients: 





(a) for a rate of 3 sec., rig = reg = 0.9, rig = 0.7; 
(b) for a rate of 5 sec., rig = ro3 = 0.7, r15 = 0.4; 
(c) for a rate of 12 sec., 7, = 0,7 AL. 


Determine the value of the variance for the arithmetic mean in 
measurements with different rates if the errors of each measurement 


are characterized by a variance of 30 sq. m. 
21.29. A random variable X obeys a distribution law with a 


probability density 


x - x? 
{OE aN OxP {-3} for x20, 
0 for <0 


The probability density of a random variable Y is given by the formula 





2 2 24,2 
ene Fa V exp {-2} for y>0O, 
0 for y < 0. 


Determine the expectation and variance of the random variable 
Z = X — Y if the random variables ¥ and Y are independent. 

21.30 Given arandom point in the plane with coordinates (X, Y), 
and x = 10, y = —10,o, = 100, 0, = 20, k,., = 0, find the expectation 
and variance of the distance Z from the origin to the projection of this 
point on OZ, which makes with OX an angle a = 30°. 

21.31 Determine the correlation coefficient for the random 
variables X and Y if X is a centralized random variable, and Y = X*, 
where » is a positive integer. 

21.32 Find the expectation and variance of a random variable 
Z = X(Y — 9) if the probability density of the system (X, Y) is given 
by the formula 


x? x 5 \2 2 
fl, 9) = oe exp {- zg lv ~ 9) + O°I}. 
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21.33 A wheel is spun and then slows down because of friction. 
When the wheel stops, a fixed radius a makes a random angle ¢ with 
the horizontal diameter; ¢ is distributed uniformly over the interval 
0 to 360°. Find the expectation and variance of the distance from the end 
of radius a to the horizontal diameter. 

21.34 Asa result of a central force, a mass point describes an ellip- 
tic trajectory. The major semi-axis a and the eccentricity of the ellipse e 
are known. Assuming that it is equally probable to sight the moving 
point at any instant, find the expectation and variance of the distance at 
the instant of observation if the observer is located at the center of 
attraction, at one of the foci of the ellipse, and the distance R to the 
point is given by the formula R = a(1 — e”)/(1 — cos wu), where wu is the 
angle made by the radius-vector R with the major axis a. (In the case 
of a motion in a central field, the sector velocity R? du/dt = const.) 


22. THE DISTRIBUTION LAWS OF FUNCTIONS OF RANDOM 
VARIABLES 


Basic Formulas 


The probability density f,(y) of a random variable Y, where Y = ¢(X) 
is a monotonic function (i.e., the inverse function X¥ = %(Y) is single-valued), 


is defined by the formula 
AY) = FAVON"Y'O)|. 


If the inverse X¥ = J(Y) is not single-valued, i.e., to one value of Y there 
correspond several values of ¥—¢,(y), vo(y), Ys(y), .-., WiC) (Figure 21)—then 
the probability density of Y is given by the formula 


fy) = 3 Feld NIKON. 


For a function of several random arguments, it is proper to start from the 
formula for the distribution function F,(y). For example, Y = 9(X,, X2), and 
let f,(%1, X2) be the probability density of the system of random variables 
(X;, Xz). If Dy is a region in the plane ¥,0 X, for which Y < y, then the distri- 
bution function is 


FQ) = | fee, 2) dx de, 


Dy 


FIGURE 21 





A LY) Vil g 
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and the probability density of the random variable Y is f,(y) = dF,(y)/dy. 
In the general case, if the Jacobian determinant for the transformation of the 


random variables (X;, X2,..., X,) to the random variables (¥;, Yo,..., Yn) 1s 
Oy, Ye OYn 
A(X1, Xap. ey Xp)  (O%2 OMe OX 
= BO, Yar---> a) [22 Wa On, 
dy, Ye OYn 


and if this is a one-to-one transformation, then 


Air Ya2> see Yn) = | D| f-(1, x2, ee ey Xn)s 
in which x;,..., X, are expressed in terms of y,,..., Yn. 


SOLUTION FOR TYPICAL EXAMPLES 


Example 22.1 A straight line is drawn at random through a point (0, /) 
(Figure 22). Find the probability density of the random variable 7 = / cos 9. 


SOLUTION. The angle ¢ is a random variable, uniformly distributed over 
the interval (0, 7) (Figure 22). 

Since here the inverse (7) is single-valued (when angle ¢ varies from 0 to z, 
the function decreases monotonically), to determine the probability density 
for 7, we apply the formula 

flr) = fold) YC); 


where 


v(m) = arccos } 


1 I 
\Y’(@)| = ——==———=-: Ss fly) = <7 
0 


for O<op<a7 


otherwise. 


FIGURE 22 
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Finally, we have 


1 
— +. for |» <5 


fin) = 4aV PF = 7? 
0 for |y| > 7. 





Similarly one can solve Problems 22.2, 22.5 to 22.7, 22.9 to 22.13 and 22.19. 


Example 22.2 A random variable Y is given by the formula 


sees for X >0, 
— aorne 
+V—X for ¥ <0. 


Find the probability density of Y if X is a normal random variable with 
parameters x = 0, D[X] = 1. 


SOLUTION. In this example, the inverse is two-valued (Figure 23); since to 
one value of Y there correspond two values of X, 


X,=—Y? = 4,(Y) 
and 
X, = Y?=4.(Y), 


by the general formula, we have 
d 2 
fi) = F-99)|- Z| + L009 


dy { a 

—exp,——> for 0< y<o, 

=<V20 4 2 4 
0 for y <0. 








dy” 
dy 








Problems 22.3, 22.4 and 22.8 can be solved in a similar manner. 


Example 22.3. The position of a random point with coordinates (X, Y) is 
equally probable inside a square with side 1 and whose center coincides with the 
origin. Determine the probability density of the random variable Z = XY. 


SOLUTION. We shall consider separately two cases: (a) 0 < z < 1/4, 


and (b) —1/4 < z < 0. For these cases, we shall construct in the plane two 
hyperbolas with equations z = xy. 


FIGURE 23 


Ly) 2) 
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In Figure 24A and B, a region is shaded inside which the condition Z < z 
is satisfied. 

The distribution function of the random variable Z is defined for 
0<z< 1/4as 


F(z) =P(Z < z) =1 —P(Z > 2) =1 — 2S), 


1/2 1/2 1 
=1-2] dy | dx = = + 2z — 2z1n4z, 
22 2ly 2 
where Sp, is the area of the region D:; 
for —1/4<z< 0, 


1/2 2ly 
F,@) = 2Sp, = 2 | dy | dx = 3 + 22 — 22 In(—42). 
: — 22 -1/2 2 
Differentiating these expressions with respect to z, we obtain the probability 
density: 
for0 <z < 1/4, 
d 
fe) = PAZ) = -2n 42; 

for -1/4<z <0, 


SA) = £ F{@) = —21n (—42). 





f>z2>0 





FIGURE 24A 


FIGURE 24B 
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Finally, the probability density for the random variable Z = XY can be 
written as follows: 
—21n4|z| for |z| < ; 
Sz) an | 


0 for |z| > 


4 
Problems 22.16 to 22.19 and 22.21 are solved similarly. 


Example 22.4 A system of random variables (X, Y) is normally distri- 
buted with the probability density 





1 
f(s, ») = sag exp {= 


Find the probability density of the system (R, ®) if 
X = Reos®, 
Y= Rsin®. 


SOLUTION. To determine the probability density of the system (R, 9), 
apply the formula 


Fe 9) = Ste 9 xe oh 


> 





where (x, y)/A(r, p) is the Jacobian determinant of the transformation from the 
given system to the system (R, ®): 


xp). |For 
ar, P) ey oy 





Therefore, 
r r?cos’*o+r?sinep) or r? 
fr 9) = gaa cmp {SESE Dm Ten {3 
The random variables R and ® are independent so that 


Sr, ) =O So) 


where f,(r) = (r/o”)e~” 2” is Rayleigh’s law, and f,(¢) is the uniform distribu- 


tion law. 
Similarly one can solve Problems 22.22, 22.23 and 22.25 to 22.27. 


PROBLEMS 


22.1 The distribution function of a random variable X is F,(x). 
Find the distribution function of the random variable Y = aX + b. 

22.2 Given the probability density f(x) of a random variable X 
(0 < x < 0), find the probability density of the random variable 


Y = In X. 
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22.3. Find the probability density of the random variable Z = aX? 
if X is a normal] random variable, x = 0, D[X] = co, anda > 0. 

22.4 Evaluate the probability density of the random variable 
Y = |X| if X is a normal random variable for which x = 0, and the 
mean deviation E is given. 

22.5 A random variable YX is uniformly distributed over the 
interval (0, 1) and related to Y by the equation tanzY/2 = e*. Find 
the probability density of the random variable Y. 

22.6 Find the probability density of the volume of a cube, whose 
edge YX is a random variable uniformly distributed in the interval (0, a). 

22.7 A straight line is drawn at random through the point (0, /). 
Find the probability density of the x-intercept of this line with the 
Ox-axis. 

22.8 A random variable X is uniformly distributed over the 
interval (— 7/2; 7/2). Find the probability density of the random 
variable Y = asin (27/T)X. 

22.9 A random variable X obeys Cauchy’s distribution law, 


1 
PO) = TE 


Find the probability density of the random variable Y if 
(a) Y=1— X°%, (b) Y = aX?, (c) Y = arctan X. 

22.10 Determine the probability density of the random variable 
Y = X", where x is a positive integer, if the probability density for X is 


1 a 
IO) = TP 


WT 


22.11 A random variable X is distributed over the interval (0, 00) 
with the probability density f,(x) = e~*. Evaluate the probability den- 
sity of the random variable Y if (a) Y* = X and the signs of Y are 


equally probable, (b) Y = + VX. 
22.12 A random variable X obeys Pearson’s distribution law: 


Tk + 1.5) 

—>———— (1 — x?) fi a IN 
iOS 

0 for |x| > 1. 


Find the probability density of the random variable Y = arcsin X. 

22.13 A random variable X is uniformly distributed in the 
interval (0, 1). Evaluate the probability density of the random variable 
Y if: 


(a) x= 5 [1+ [ex {-Sh at], 
(b) = ; [ + = |e exp{— 5} at]. 


* 22.14 The random variables XY and Y are connected by the 
functional dependence Y = F,(X). The random variable X is uniformly 
distributed over the interval (a, b) and F,,(x) is its distribution function. 
Find the probability density of random variable Y. 
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22.15 A random variable X is uniformly distributed over the 
interval (O, 1). Assume that there is a function f,(t) > O satisfying the 


condition (bate f(t) dt = 1. The random variables ¥ and Y are related 
by the equation X = ies Ft) dt. Prove that f(t) is the probability 
density of random variable Y. 


22.16 A system of random variables (X, Y) obeys the normal 
distribution law 


a 1 (e Ve 
DOE ae op {—3 (3th 
What distribution law does the random variable Z = X — Y obey? 
22.17. Find the probability density of the random variable 
ZX ¥ Af: 
(a) the probability density f(x, y) of the system of random variables 
(X, Y) is given, 


(b) X and Y are independent random variables with probability 
densities 


‘a= <= exp {5} ese eames: 


oe 
yexp {3} for OS y<o, 
LO) = | 2 
0 for y <0, 
(c) X and Y are independent normal random variables with 
X = y = O and variances o2 and o3, respectively. 


(d) X and Y are independent random variables with probability 
densities 


1 

faSine ORS 

0 for |x| > 1, 

yy 
exp, —=> for O<y<o, 
Os ae ae j 
Ay) = 
0 for y <0. 


22.18 Find the probability density of the random variable 
Z= X/Yif: 

(a) the probability density f(x, y) of the system of random vari- 
ables (X, Y) is given, 

(b) X and ¥ are independent random variables obeying Rayleigh’s 
distribution law 


x x 
(oe ae xP {-35} for x 20, 
0 for x <0, 
Et ee ‘ 
fo) (7 {dah for 70. 
0 for y <0, 
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(c) X and Y are independent random variables with probability 
densities 





SAX) = Hoes {-=} (—2% <x < 0), 
xo 


(d) the system of random variables (X, Y) obeys the normal distri- 
bution law 


1 { 1 (= xy y )} 
x,y) = e=Xp § 5 oe I  - r +=]? 
IY) 270,0yV | — r? : 2(1 — r*) \oz Ox0y OY 


22.19 Find the probability density for the modulus of the radius- 
vector R= VX? + Y? if: 
(a) the probability density f(x, y) for the system of random 


variables (Y, Y) is given, 
(b) the random variables X¥ and Y are independent and obey the 
same normal distribution law with zero expectation and mean 


deviation E, 
(c) the probability density for the system of random variables 


(X, Y) is given by the formula 








1 
—; for x*4+ y? < R?’, 
I(x, y) = 570" 
0 for x? + y? > R?, 


(d) X and Y are independent normal random variables with the 
probability density 





fla, ») = sige {-S =D), 


(e) the random variables X¥ and Y are independent and obey a 
normal distribution law with X = y = 0, and variances o2 and 2, 


respectively. 
22.20 A system of random variables (X, Y) has the probability 


density 


I 
2n0,0,V | af? 


x {sq oa [FS*) + AY - 2-2-7 ]}. 


I(x, y) = 


22. 
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Find the linear transformation leading from random variables X, Y 
to the independent random variables U, V. Evaluate the mean-square 
deviations of the new random variables. 

22.21 Both roots of the quadratic equation x? + «x + B=0 
can take all values from —1 to +1 with equal probabilities. Evaluate 
the probability density for the coefficients « and 8. 

22.22 The rectangular coordinates (X, Y) of a random point are 
dependent random variables, and x, y, oy, oy, ry are given. Find the 
probability density of the polar coordinates (7, p) of this point if 
Semen Pee PD ee 


Ox " Oy 





What distribution laws do T and ® obey if r,,, = 0? 

22.23 Let S = So + Vot + (At?/2), where So, Vo and A are 
normal random variables whose expectations and covariance matrix 
are known. Evaluate the probability density f(s | 1). 

22.24 Find the probability density of the nonnegative square root 
of the arithmetic mean for squares of normal centralized random 
variables, Y = V1/n >"_, X?, if the variance D[X,] = o? (j = 1,2, 

..5 A). 
22.25 The rectangular coordinates of a random point (X,, Xo, 
..., X,) have the probability density 


Soya! hs yal. 
FQ, Xa5+-+5 Xn) = (27207 exp { Tq? Zz vey 


Find the probability density for n-dimensional spherical coordinates 
of this point R, ®,, D,,..., O, if: 


X, =Rsin9Q,, 
X, = Rsin®,cos®,, 
X3; = Rsin ®, cos D, cos 2, 


Xn-1 = Rsin ®D,_, cos D, cos OB, --- cos O,_ 2, 
X, = Rcos®, cos ®,---cosO,_,. 


22.26 Two systems of random variables (X,, Xo,..., X,) and 
(Yi, Y2,..., Yn) are related by linear equations. 


y= S ans Yy eS? re 8) 
j=l 


where |a;;| # 0. Evaluate the probability density fU()1, yo,..-, Yn) if 
the probability density /. (x1, X2,..., X,) iS given. 

22.27 Find the distribution law of the system of random variables 
(R, ©), where R = VX? + Y? + Z? is the radius-vector of a random 
point in space, and © = arcsin Y/R is the latitude, if the probability 
density of the rectangular coordinates (X, Y, Z) is f(x, y, z). 
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23. THE CHARACTERISTIC FUNCTIONS OF SYSTEMS AND 
FUNCTIONS OF RANDOM VARIABLES 


Basic Formulas 


We define the characteristic function of a system of random variables 
(X,, X2,..., X,) as the expectation of the function exp {i >%_, u,X,}, where 
u, (k = 1,2,..., ) are real quantities, and i = V —1: 


| a ee a OTe Ug,..-, Un) = M | exp {i > u.Xe}| : 
k=1 


For continuous random variables, 
Foote eal is Uo, cng Un) 


=| { ef exp {i > UX > f(X1, Xo). . 5 Xn) AX, dX_-++- dXy. 
Sees — © k=1 


The characteristic function of a system of independent random variables 
equals the product of the characteristic functions of the random variables 
contained in the system: 


For a multidimensional normal distribution with expectations ¥,, Xo,..., 
xX, and covariance matrix 


ky, Ky Ne. kin 
keel = koi kao Kon 
kat kas Kee 


we have 
n n n 
E(uy, Ua,..., Un) = exp {i > u,X, — ; > », kat} 
rT=1 r=1s=1 


If the appropriate moments of a system of random variables exist, 
M[XPX?-- X72) 
. O71 at Fn Be, xe, (Ur, Ua, - +» Un) 
= exp; < — > 1. -—— yO a“ aS él 
k=1 Ou; ous win ASR ou; 


If the random variable Y = ¢(X), then 





Uy SUg = Su, = 0° 


E(u) = Mfe™"] = ["_ eory(a) de. 


The characteristic function of a system of random variables, (Y1, Yo,..., 
Y,), of which each is a function of other random variables 


Y, = ei(X, Xo, ee Xm) > 
Yo = pl Xi, Xo, . ae) Xm) 


q 


Fi oe Pl X1; Xo, a) Xm) > 
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-@ 


= | wae (i exp {i 3, CHEE) 6 (CAEEEEE dx, +++ dX_. 


The characteristic function of a subsystem of random variables can be 
obtained from the characteristic functions of the system by replacing the 
variables u,, corresponding to random variables not in the subsystem, by zeros. 


SOLUTION FOR TYPICAL EXAMPLES 


Example 23.1 A particle starts from the origin and moves in a certain 
direction for a distance /,. Then it changes its direction many times, making a 
random walk: for a distance /,, then for a distance /3, and so forth. The trajectory 
of the wandering particle consists thus of segments of lengths /,, /2,..., /,, the 
direction of each being determined by the angle a, made with the Ox-axis. 
These angles are uniformly distributed in the interval (0, 27), and they are 
independent. Find the characteristic function of the coordinate X of the end- 
point of the trajectory and the corresponding probability density. 


SOLUTION. The coordinate XY is determined as the sum of the projections 
of segments J, on the Ox-axis: 


n 
X= D |, cos ay. 
k=1 
Since «, are independent, 


S (a1; @2,.--; an) = I I (&%)s 


and 
] 


Slow) = $20 


0 for ay < 0, Xe > Qn. 


for 0 < ay < 27, 


Therefore, 


E,{u) = i nee | exp {iu » 1, COS on} Me woe Gq) doey +++ dee 
mee ira k=1 
n 27 n 
= I] i exp {iul,, cos ee = [I Jolt.) 
0 20 nie? 


where Jp is the Bessel function of the first kind of zero order. 
From this, 
] n 
I) = = e~™ TT] Jo(i,u) du, 
k=l 
or 


Pe 
f(x) = =| COs ux TI Jo(l,u) du. 
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Example 23.2 Given the covariance matrix ||k,,|| of a system of six normal 
random variables X,, Xo,..., Xg with zero expectations, evaluate the expecta- 
tion of the product ¥2X,X, by applying the method of characteristic functions. 


SOLUTION. The expectation M[X2X,X,] is determined by the distribution 
of the subsystem (X,, X3, X,). The characteristic function corresponding to 
this subsystem has the form 


4 4 
Era .x3.x4 U2» U3, Us) = exp {-3 >» > kyr} 


Tr=2s=2 


The required expectation can be obtained by differentiating the character- 
istic function four times: 


a 


M[X3X2X,] = 6u2 Ou Gu, 





Ug =Ug=u4q=0°- 


The first method. If we expand the characteristic function in a power 
series according to its exponent, then we find that in calculating the desired 
mixed partial derivative for vu. = ug = u, = 0, only one term of the expansion 
is different from zero: 

1 Gt 40 4 
M[X2X2X4] ee Ore3 Dace k,UrUs) 


8 Gu? Gus Ou, 








Ug =Ug =uq=O0°- 


The mixed derivative of the square of the polynomial for uw, = ug = uz = 0 
will have terms different from zero if before differentiation they were propor- 
tional to u2u,u,; that is, 

1 O*(Qkggk4U3Ugls + 4kagkgql3uea) 
4 Guz OUg Ou, 
= Kggkoq + 2Kogkaa. 


The second method. For convenience, we introduce the notation 


M[X3X2X4] 5 


Th = ba k, Us 
s=1 
Then 
4 6 
GE é 1 S : i E 
Be Sa 75 U,Us? = — ET, 
Cug Cus r a area | he 
2 O 
CPE OT 
a2 7 E73 — EE => Er? — Ekgss, 
a3 
OE 
ao = — Er2r, + 2ET3ko3 + Er5ks3, 
Oug Clg 
OE 


= Etter, — 2Et37 ok 34 = Eriko SS 2E757T4Ko3 
+ DEK 4Ksg == Erotgkg3 + Ekoska3- 


Gu2 Guy OU4 


For u, = ug = -+-:- = Ug = 0, we have 


x ES Fs, ry = 0, 
which implies that 
M[X3X2X4] = kgakoa + 2Kaakaa. 


Similarly one can solve Problems 23.11 to 23.14. 


23, 


THE CHARACTERISTIC FUNCTIONS OF SYSTEMS 
PROBLEMS 


23.1 Prove that the characteristic function of the sum of inde- 
pendent random variables is the product of the characteristic functions 
of its terms. 

23.2 Given Ey, ...x,(Ui, U2,.--, Un), the characteristic function 
of the system (X,, Xo,..., X,), find the characteristic function of the 
sum Z = X, + Xo +--+ + Xy. 

23.3 Find the characteristic function of the linear function 
Y = >%.,4,X, + c of the random variables X,, X2,..., X, whose 
characteristic functions are given. 

23.4 Find the characteristic function for the square of the 
deviation of a normal random variable from its expectation, 
Y = (X — x)*, and the moments of Y. 

23.5 Find the characteristic function of the random variable 
Y = aF(X) + b, where X is a random variable and F(x) is its distri- 
bution function. 

23.6 Find the characteristic function of the random variable 
Y = In F(X), where X is a random variable and F(x) its distribution 
function. Evaluate the moments of Y. 

23.7 Find the characteristic function of the projection of a segment 
a on the Oy-axis if the angle made by this segment with the Oy-axis is 
uniformly distributed in the interval (0, 27). Evaluate the probability 
density of the projection. 

23.8 Find the characteristic function of a system of two random 
variables obeying the normal distribution law 


1 
2n0,00V 1 = r? 
I (x— xP wx-xY-¥), ORT zr) 
ati {-3 =?) | o 0102 te 
23.9 Find the characteristic function of a system of nm random 
variables (X1, X2,..., X,), obeying a normal distribution law, if the 


expectations of the random variables forming the system are all equa! 
to a and their covariance matrix is 


I(x, y) = 


co? ac® 0 0 0 -:. 0 0 
ao® co? aor 0 0 0 

| kal] = 0 ace o% aor 0 0 
0 0 0 0 0 --- oF aot 
0 0 0 0 0 ao* oa 


(8S 1, 2): 


23.10 Find the characteristic function of 


LS > x 


m=1 
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in which (X,, X2,..., Xn) is a system of normal random variables and 
Xm =m, 
gon lw. 


23.11 Using the method of characteristic functions, find 
M[(X? — 02)(X2 — o?)] if X1, ¥2 are normal random variables for which 
Xx, = Xo = 0, 

M[X2] = M[X3] = 07, and M[X,X2] = kie. 


23.12 Applying the method of characteristic functions, evaluate 
(a) M[X7X2 X33], (b) M[(X7 =: o* (X53 — o° (X38 a o*)], if Xi, X2; X54 
are normal random variables for which x, = X, = X¥, = 0, M[X?] = 
M[X3] = M[XY3] = 0, and ki2, kis, kes are the covariances between 
the corresponding random variables. 

23.13 Applying the method of characteristic functions, evaluate 
M[X,X.X3] if X1, X2, Xs are normal centralized random variables. 

23.14 Using the method of characteristic functions, express 
M[Y,X,X,X,] in terms of the elements of the covariance matrix k,, 
of the system of random variables (X;, X2, Xa, X4), whose expectations 
are zero. 

23.15 Prove that the central moment of even order of a system 
of m normal random variables is given by the formula 


Br, 12 Stax oS M[(X, —- X1)"1(Xe =~ X2)"2- : (X) —_ X,)'] 


rylrgt-++ ry! 
= es Kot oe *Kenstes 


25s! 
where r; + ro +:--+ r, = 2s, and the summation is extended over all 
possible permutations of 2s indices m,, mo,..., m, and 4, lb, ..., ln, of 


which r, indices equal 1, r, indices equal 2,..., r, indices equal n. 

23.16 Given a system of dependent normal random variables 
(X,, X2,..., Xn), prove that the random variable Y = D7_, a,;X,; + b 
also obeys a normal distribution law. 

23.17 The output of a factory consists of identical units, each of 
which in the rth quarter of the year (r = 1, 2, 3, 4) is with probability 
p, of first quality and with probability g, = 1 — p, of second quality. 
An item of first quality costs S, dollars and an item of second quality, 
S_ dollars. Evaluate the characteristic function of the system of random 
variables (XY, Y), where X is the cost of items produced during the first 
three quarters of the year, and Y the cost during the last three quarters 
of the year. Evaluate the covariance of X¥ and Y. The number of items 
produced in the rth quarter is N,. 
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Basic Formulas 


The operation of finding the distribution law of a sum of mutually inde- 
pendent random variables in terms of the distribution laws of its summands is 
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called convolution (composition) of distribution laws. If X and Y are indepen- 
dent discrete random variables, the distribution series of the random variable 
Z = X + Y is given by the formula 


P(Z = z;) = > P(X = x;)P(Y = z, — x) = PCY = y,)P(X = 2; — yx), 


where the summation is extended over all possible values of the random 
variables. 

If X and Y are continuous random variables, the probability density for 
the random variable Z = X + Yis 


fie) = [fe - dx = | K0fee - dy, 


and the distribution function F(z) is determined by the formula 


Fe) = | [ f.00f,0 de dy. 


xt+y<zZz 


The probability density f,(y) of a sum of independent random variables 
Xi, Xo,..., X, (Y = X, + Xo +---+ X,) can be found either by using the 
characteristic functions in accordance with the formula 


1) = 5 FTL Belo} a, 


where 


wo 


E,(t) = { fax) dx, 


or by successive applications of the convolution formula for two random 
variables. 


SOLUTION FOR TYPICAL EXAMPLES 


Example 24.1 Find the probability density of the sum of two independent 
random variables Z = X¥ + Y, where X is uniformly distributed over the 
interval (0, 1), and Y has Simpson’s distribution (Figure 25): 


y for O< y<l, 
fiy)=452-—y for l<y <2, 
0 otherwise. 
LY) 
FIGURE 25 
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SOLUTION. Since the functions f,(x) and f,(y) are different from zero 
only for particular values of their arguments, it is more convenient first to find 
the distribution function of the random variable Z. We have 


F@) = PZ <2) = | [fC40) dx dy, 


Dz 


where D, is the region inside which x + y < z, and none of the functions 
f(x) and f,(y) vanishes (Figure 26). 

The shape of the integration domain depends on which of the three intervals 
(0, 1), (1, 2) or (2, 3) contains z. Computing the integrals for these cases, we 
obtain 


0 for z< 0, 


z3 


[pore “4. & = 3 Sr Sei: 
0 0 


2-1 1 z-1 Z- x 1 Z2-x 
{ dx [ ydy + | dx | 2-day + { dx | ydy 
ie] 0 0 1 z-1 ie) 


z= 3 = 3 
eae for ] < Z < 2, 


FZ) = 
=z—-I+ 


2 1 
1-[ 2- na dx = 1-5-2) for 22223; 
z-1 2-y 


] for z> 3. 


By differentiation with respect to z, we find the probability density: 


2 


ee ee ee for 1<z<<2, 


fiz) = 7 
(22 — 62 + 9) for 2<2<3, 


0 for z<Oorz>3. 


FIGURE 26 
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1) Normal distribution 


2) Simpson’s law 


Sk. 


3) The: convolution of Simpson's law 
and the uniform distribution 


FIGURE 27 


The functions f(x), f(y) and f(z) are represented in Figure 27. 
Problems 24.1, 24.2, 24.4 and 24.8 can be solved similarly. 


Example 24.2 A point C is chosen at random on a segment A, Az of length 
2L. The possible deviation of the midpoint of segment F,F, = 2B from the 
midpoint of A,Az has a normal distribution with mean deviation E. Find the 
probability that the distance from C to the midpoint of segment F,F, does not 
exceed a given quantity (d + B). 


SOLUTION. Let X denote the random deviation of the point C from the 
midpoint of A,A2, and let Y be the deviation of the midpoint of F,F, from 
the midpoint of A,A, (Figure 28). Then the deviation of the point C from the 
midpoint of segment F,F, is Z = Y — X. Since the function f,(y) does not 
vanish on the real axis, 





fAz) = ‘_ PADS (z + x) dx = sf [2 nV exp {=p o@t Cah ax dx 
“ema Blo +929 


The distance from C to the midpoint of F,F, will not exceed the quantity 


d+ B if |z| < d+ B. Therefore, the probability of this event is given by the 
formula 








d+B 
-(d+B) 


ee ee tas e(L+z e{L—Zz 
AL Jase) | E )+o(-=)| a 


_ E (L+d+ByE | (L-a@-B)E | E puta+Be , 
7 ae If O(t) dt — { M(t) at| = — O(t) dt 
¢ 








L-d-B)/E L+a+B)/E 2L Ji-a- BE 
I 7 a PF ak BB tek 
== {i + B+ ayo(L+ 3+") aa ¢ See ; ayo(= 2 “) 





* aloe {-Be + 2+ 0} - op {-Be-a- yj} 


132 FUNCTIONS OF RANDOM VARIABLES 





FIGURE 28 


In a similar manner Problems 24.3, 24.5 to 24.7, 24.13 to 24.15 can be 
solved. 


Example 24.3. Two groups of identical items, of 1, and ng items each, 
are mixed together. The number of defective items in each group (X and Y, 
respectively) has the binomial distribution: 


P(X = m) = Cr p™q™—™, 

P(Y = m) = CR ptqe-™. 
Find the distribution series of the random variable Z = X + Y. 
SOLUTION. For the probability P(Z = z) to be different from zero, Z 


must be integral-valued and lie on the interval (0, n, + m2). Applying the general 
formula and taking into account that 0 < x < z, we obtain 


2 
P(Z — z) = > Ce pg: “Ce pe gate 
x=0 


= p?q™ +ny-2 oom Cia = Ce. FO 1 ie i 
(2 = 0, 1,.2,..4., Ry ng): 
(The equality 33-9 Ci,Ci7* = C%,+n, can be proved, for example, by induc- 
tion. First, one proves it for nm, = 1 and for any ng.) 


This problem can also be solved by using characteristic functions. For the 
random variables X¥ and Y, we have 


E,{t) = M[e*!] = (pe* + 9), 
E(t) = Mie] = (pe* + gq)". 
Since X and Y are by hypothesis independent, we have 


E{t) = E,{t)E,(t) = (pet + q)*"2. 


From this, it follows that the random variable Z also has a binomial 
distribution. 
Similarly one can solve Problems 24.12 and 24.16 to 24.21. 
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Example 24.4 Let X,, Xo,..., X, be independent random variables, each 
of which obeys Poisson’s law 


m 


a 
P(X, = m) = wie 


with the same parameter a. 

Find the distribution series of the random variable Y = >7_, X; and 
prove that the centralized and normalized random variable (Y — y)/c, for 
n— oo has a normal distribution. 


SOLUTION. We find the characteristic function of the random variable X;: 





S ¢ . (ae"*)* it it 
EG) = M[e#%s] = 2° ike = e-4 > o> e-aeaett _. patelt— 1) 
= k=0 : 


Since the random variables X, are independent, the characteristic function 
of Y is given by the formula 


E(t) = [I Bat) = erat”. 


Consequently, the random variable Y has Poisson’s distribution law with 
parameter na. Use the notation Z = (Y — y)/o,. The random variable Z is 
obtained as a result of normalizing and centralizing the random variable Y. 
It is known that for Poisson’s law, the expectation and variance are numerically 
equal quantities, both equal to the parameter of this law. Thus, 





Evaluate the characteristic function of Z: 


= e~i/74 exp {nalexp (=) - i]} 
= e-Mg-it’na exp {na exp ral 


= e7na -it¥na ei ox )} 
e exp {na{ + = Wan a 


f? roe? 
ee {na( 5 + 31 Gap? — he 


Consequently, 


E{t) 


l 





ll 


: i? 
lim Et) = exp {-5}. 


The limit of F,(t) is the characteristic function of the random variable 
with a normal distribution, with expectation zero and variance one. 
One can solve Problems 24.6, 24.10, 24.19 and 24.20 similarly. 
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PROBLEMS 


24.1 Find the probability density of the sum of two independent 
variables, each of which is uniformly distributed over the interval (a, b). 

24.2 Find the convolution of two uniform distributions with 
parameters a and b (6 > a), if the dispersion centers for both distribu- 
tions coincide and the parameter of a uniform distribution law is defined 
as being half the length of the interval of the possible values of a random 
variable. 

24.3. The random variable XY obeys a normal distribution law 
with parameters x and o,, Y obeys a uniform distribution law with 
parameter (5 — a)/2 and y¥ = (a + 6)/2. Find the probability density 
of the random variable Z = X — Yif X and Y are independent. 

24.4 Find the probability density of the sum of three independent 
random variables, each of which is uniformly distmuted over the 
interval (a, 5). 

24.5. Find the convolution of a normal law (with expectation x 
and mean deviation £) and a uniform distribution law, given in the 
interval (x — /, x + /). Find the relative error caused by replacing the 
resulting law by a normal law with the same variance and expectation. 
(Perform the computations for x =0,/= E, 1 = 2E, | = 3E and 
! = 4E at point z = 0.) 

24.6 Find the probability density of the random variable 
Z = X + Yif the random variables X¥ and Y are independent and obey 
Cauchy’s law: 


h k 
Sx) = TEFEN aF > f(y) = WT EFOSC 


24.7 Find the probability density of the sum of two random 
variables X and Y, obeying the hyperbolic secant law: 


] 
7 es y 








SAX) = SAY) = 


a SES’ 
24.8 Let X and Y be independent random variables with 
probability densities given by the formulas 


fia) =zexp{-3}  O<x< a), 


Find the probability density of the random variable Z = X + Y. 
24.9 Find the probability density of the distance between the 
points A,(X,, Y,) and A2(Xe, Y.2) if the systems (X,;, Y,) and (X, Y.) 
are independent and uniformly distributed. The unit dispersion ellipses 
of the points A, and A, have major semi-axes (a@;, 6) and (dg, ba). The 
angle made by a, and ay is «. The centers of the unit ellipses coincide. 
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24.10 Let X; Gj = 1,2,...,) be normally distributed indepen- 
dent random variables with x; = 0 and D[X,] = |. Prove that for the 
random variable Y = >3_, X7, the probability density is determined 
by the formula 


TAY) = uate exp { — An <y< oo), 


= 


24.11 An instrument gives a systematic error a and a random 
error obeying a normal distribution law with mean deviation E. Prove 
that for E > d, the probability p(a) of an error within a given tolerance 
range +d is approximately | by the formula 


Bays ae rex {-e°(z) } 
b= Je f < pd? 


24.12 Two persons fire independent shots, each at his target, 
until the first hit is scored. Find the expectation and variance for the 
total number of failures and the distribution function for the number 
of failures if the probability of hitting a target at each shot is p, for the 
first marksman and pz for the second. 

24.13 What should be the reserve shear strength of a sample so 
that the probability that it will support a load is at least 98 per cent? 
The errors in the determination of the given load and of the maximal 
load obey a normal distribution with mean deviations: E,, = 10%, 
E,, = 5%G2, Where 9, and G2 are the expectations for the given and 
maximal loads and g, = 20 kg. 

24.14 A navigational transmitter is installed on each shore of a 
sound of width L. The transmitters serve the ships passing through the 
sound. The maximal ranges of each of the transmitters are independent 
random variables with expectation x and mean deviation E. Assuming 
that any distance between the course of a ship and the shores is equally 
probable, and that 2x < L, find (a) the probability that a ship will be 
served by two transmitters, (b) the probability that a ship will be served 
by at least one transmitter. 

24.15 Observer A moves from infinity toward observer B. The 
maximal distances for sighting each other are independent random 
variables with expectations x, and X,, respectively, and mean deviations 
E,, E. Find the probability that A will sight B first. 

24.16 Find the convolution of m exponential distributions with the 
same parameter 4. 

24.17 Let X and Y be independent random variables, assuming 
integral nonnegative values i and j with probabilities PLY = i) = 
(1 — aja’ and P(Y = /) = (1 — b)b’, where a and 5b are positive 
integers less than one. Find the distribution function of the random 
variable Z = X + Y. 


where 
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24.18 Let X and Y be independent random variables; X assumes 
three possible values 0, 1, 3 with probabilities 1/2, 3/8, 1/8, and Y 
assumes two possible values 0 and 1 with probabilities 1/3, 2/3. Find 
the distribution series of the random variable Z = X + Y. 

24.19 Let X, Y be independent random variables, each of which 
obeys Poisson’s distribution: 


PLY = m) = 


P(Y =m) = ens. 


Find the distribution series of the random variable Z = X¥ + Y. 

24.20 Let X; (j = 1,2,...,) be independent random variables, 
each of which takes only two values: 1 with probability p, and zero with 
probability g = 1 — p. Find the distribution series of the random 
variable Y = >7_, Xj. 

24.21 Let X and Y be independent discrete random variables 
assuming positive integral values k from 1 to oo with probability (1/2)*. 
Find the distribution function of the random variable Z = X + Y. 


25. THE LINEARIZATION OF FUNCTIONS OF RANDOM 
VARIABLES 


Basic Formulas 


Any continuous differentiable function, whose derivative is finite at a 
given point and for sufficiently small variations about the point, can be replaced 
approximately by a linear function, by using a Taylor series and retaining only 
the linear terms. If the probability is small that the arguments of the function 
will assume values outside the region where the function can be considered 
linear, this function can be expanded in the vicinity of the point corresponding 
to the expectations of its arguments. The approximate values of the expectation 
and variance in this case are given by: 

(a) for the function of one random argument Y = 9(X), 


y= P(x), DY] & [p’)PDLX]; 


(b) for a function of many arguments Y = 9(X,, Xo,..., X,), 


y x p(X; Xa, eae Xn) 


ours $ (yous S$ 2) 


t=1 


where k;; denotes the covariance for the random variables X, and X;, and 
dg/Ox; are the derivatives computed for values of the arguments equal to the 
expectations. 
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If the random arguments are mutually uncorrelated, then 


piy}= > (2) DLX,]. 


t=1 


For more accuracy in the results of linearization, in the expansion of the 
function one must retain, beside the first two terms, some higher-order terms 
as well. If one retains the first three terms of the series, then the expectation 
and variance are determined by the formulas: 

(a) for a function of one argument Y = 9(X), 


= 93) +5 "PL, 


D[Y] = [p'@) PRX] + Fe’ @PtualX ] — D°[XT} + oe" rs LX]; 


(b) for a function of several random arguments Y = 9(X1, Xo,..., X,,) the 
expectation is given by the formula 


Q2 
x 


= iS 2 Og 
Y P(X, Xe,..-, Xn) + ‘ D[X;] + 2 Oi ox 


NI 
M: 
x 

=nl Or 


i 
in the general case and by the formula 


oe? 


al) 


= =e = 1< 
FR Oh, Fay ) + 5D 5 3 D[X;] 
c=1 


Ele 


in the case when the random arguments are mutually uncorrelated. If the 
random arguments are mutually independent, then the variance is given by the 
formula 


Diy] = > ($2) Dix) +5 > (FS) talxd - DMD 


t=1 4 


+ z (=e) PIPL a > (FE) (FS) uslxa. 


Ox; 





SOLUTION FOR TYPICAL EXAMPLES 


Example 25.1 The expectation of the number of defective devices is given 
by the formula 
P m™ 
r= w{i-(1- 2)". 


where P is the probability that the trial of one device is considered successful, 
Q) is the average number of successful trials until the first failure occurs, N is the 
number of devices tested and m is the number of trials (successes and failures) 
for each device. 
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Using the linearization method, find the dependence of the expectation 
and variance of the random variable T on m if N, P and Q are independent 
random variables, whose expectations and variances are: 


MIN] =5, M[P]=08, M[Q]=4, 
DINJ=1, D[P]=0.1, D[P]=02. 


SOLUTION. Applying the general formulas of the linearization method, we 
obtain 


MIT] = a1 = (1 = £y") = 5(1 — 0.96"), 





oT oT oT 
DIT] = (= a DIN] + (2 i D[P] + (= =) DIO], 
where 
aT _ oT ay ( _ zy 
on On N=f, P=3,Q=@ = on 
— yz \m-1 
= (HE (1 = =) = 1 — 0.96" — 0.04m0,96"-3, 
On wn 
Tr mA \m-1 
Get ( = F) = 0,25m0.96"-1, 
op @ @n 
oT _ _9.05m0.96"-?, 
Be 


D[T] = 0.00835m20.962"-» — 0.08m(1 — 0.96")0.96"-? + (1 — 0.96")2. 


The approximate values of the expectations and variance of T for different 
values of m are given in Table 8. 


TABLE 8 





Similarly one can solve Problems 25.1 to 25.11, 25.14, 25.17 and 25.19 to 
25.22. 


«Example 25.2 The maximal altitude of a satellite is given by the formula 


y= Yo + (R + | 1], 
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where 


V2 7 EEE b V2 ED WGP A 
A= ier (1 + 22), l= V1 — 4X1 — A) cos? ©, 


Yo is the altitude of the active part of the trajectory, g the acceleration of gravity 
on the surface of the earth and R the radius of the earth. 

The function Y can be linearized in the domain of practically possible 
values of the random arguments. The initial velocity V and the launching 
angle © are normal random variables with probability density 


] 
2ro,0,V 1 — r? 


x exp {aa (PY + (FY - 2 Eh} 


Find the approximate value of the variance for the maximal altitude of the 
satellite. 


fv, 9) T 


SOLUTION. Since the given function is linearizable in the domain of the 
practically possible values of the random arguments, 


DIY] x (=) DIV] + (5 ) D[O] + 2(7 ON EF hoo 


where Kye = royOg, 


BY _ MR + yo) — AQAA — 1) cos? O + 1 + DD 


av vi(1 — 4)? 
oY _ A(R + yo) sin 28 
00 I : 


and X and / are computed for V = 0, © = 6. 
One can solve Problems 25.13 and 25.23 in a similar way. 


Example 25.3. Let X and Y be independent random variables with 
probability density 


SAx) = aS O<x< 1), 


Sy) = wi O<y<1l). 


Using the linearization method, find the expectation and variance of the 
random variable Z = arctan X/Y. Correct the results obtained by using the 
first three terms of the Taylor series. 


SoLuTION. Using the general formulas of linearization, we have 


M[Z] ~ arctan > DIZ] = (2) DLX] + (2) DIY], 
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where 
x dx 2 


papail _2 

ae cas VI-x2 7 
21 x*dx a 1 

Dix] = Diy] == | 7 - #=5-] 


a _ a 
ax Ox 








Thus, the linearization method gives 


X of 
M[Z] ~ arias =a 


am? 7? — 8 m7? — 8 


Considering the next term of Taylor’s series, we obtain 
xX 1 ((@Z eZ 
M[Z] ~ an + 5 {(F2)Pm) + (F2)Ptri}- 


D[Z] = (2) D[X] + (5 ay D[Y] 


+ 3{(F3) en - Dxy + (Yar - vary} 


a2Z aZ ?Z aZ eZ 
+ 5g DIXIDLY] + Fy Gamal X] + Fy Ge mol VI, 
where _ 
OL _ KY 
ox? (%? ae yy? = 8 , 
eZ 2xy i 


ax Oy = (2 + 7)? = 0, 
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Bal X] 


Hs[Y] = mg — 3mym, + 2m3 


an x® dx [2s x? dx 
= 5 — 3x + 2x8 
V1 — x2 VT — x 


dee 1616s 
30 7 mm 7 3a 





Ma[X] = pal Y] = mg — 4mymy + 6mm, — 3m} 
3 2 4 4 ] 16 4 3 48 
Bag oe ae ae 8 ae 
Therefore, taking into account the quadratic terms of the Taylor series, we 
obtain 


nm? — 8 a Tx? 3 
DIZ]}= 46 + wie t ae 


Similarly one can solve Problems 25.12, 25.15, 25.16 and 25.18. 


PROBLEMS 


25.1 The amount of heat Q in calories produced in a conductor 
with resistance R by a current J in time T is given by the formula 


QO = 0.24/?RT. 


The errors in the measurements of J, R and T are independent ran- 
dom variables with expectations i = 10 amps, 7 = 30 Q, t = 10 min. 
and mean deviations E; = 0.1 amp., E, = 0.2 Q, E; = 0.5 sec. Find 
the approximate value of the mean deviation of the random variable Q. 

25.2 The fundamental frequency of a string is given by the formula 

1 P 
ea ME 
where P is the tension, M@ the mass of the string and L the length of the 
string. 

Given the expectations p, m, | and mean-square deviations op, 
Om, 9, find the variance of the fundamental frequency caused by the 
variances of the tension, mass and length of the string if the correspond- 
ing correlation coefficients are rp), pms 'mi- 

25.3 The resistance of a section of an electric circuit is given by 


the formula 
1 2 
2 _ 
gece s(or ey + (QL ~ ge) 


where R denotes the ohmic resistance, L the inductance of the conductor, 
C its capacity and Q the frequency of the current. 
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Evaluate the mean error in the magnitude of the resistance as a 
result of errors in independent measurements of R, L, C and Q, if one 
knows /, /, €, @ and the mean deviations Ep, E;, Ec, Eg. 

25.4 If the elements of a circuit are connected in parallel, the 
intensity of the current in the circuit is given by the formula 


E 
[= ——!> 
r+ 
n 


where E is the electromotive force across the system, W is its internal 
resistance, 7 is the number of elements and R is the resistance of an 


external section of the circuit. 
Using the linearization method, find the expectation and variance 


of the intensity of the current if the random variables E, R and W are 
independent and @, 7, W, og, ox, ow are given. 

25.5 Applying the linearization method, find the mean deviations 
E,, and E,, which characterize the variance of coordinates of a mass 


point moving in a vacuum, if 


2 
VEVPese: V=vF ano = i, 


where V is the initial velocity of the point (6 = 800 m./sec., Ey = 0.1 
per cent of 0), T is the time of the flight (¢ = 40 sec., E; = 0.1 sec.), 
© is the launching angle (6 = 45°, Ey = 4’) and g is the acceleration of 
gravity. 

The random variables V, T and @ are independent and normal. 

25.6 Find the approximate value of the mean value of the error 
in estimating the projection V, of the velocity of a ship on a given 
direction. Errors are due to measuring the velocity V and the angle g of 
the course. Here V; = —V cosq, Ey = 1 m./sec., E, = 1°, and the most 
probable values of V and q are 10 m./sec. and 60°, respectively (V and g 
are independent normal random variables). 

25.7 Is the linearization method applicable under the assump- 
tions made in the preceding problem if the error in the computation 
formulas must not exceed 0.2 m./sec. ? 

25.8 Find the approximate value of the mean-square deviations 


for rectangular coordinates of a random point 
X = Hcotecos 8, 
Y = Hootesin§, 
Z=H, 


ifthe random variables H, ¢ and are independent and their expectations 
and mean-square deviations are equal, respectively, to: h = 6200 m., 


é = 45°, B = 30°, oy = 25 m., og = o, = 0.001 radians. 
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25.9 The passage from spherical to Cartesian coordinates is 
given by the formulas: 


X = Rsin ©cos O, 
Y = Rsin Osin O, 
Z= Rcos ©. 


The errors in the determination of ©, Rand ® are independent with 
mean-square deviations og = 10 m., og = og = 0.001 radians. Find 
approximate values for mean-square deviations of the rectangular 
coordinates if 6 = ¢ = 45°, 7 = 10,000 m. 

25.10 The approximate expression for the velocity of a rocket 
at the end of the operation of its engine is given by Tsiolkovskiy’s 
formula 


V= vindt®, 


where U is the effective velocity of gas flow, g the weight of the rocket 
without fuel and Q the weight of the fuel. 

The variance of the weight of the fuel is characterized by the 
deviation Ey. Find the approximate value of the mean deviation of the 
velocity caused by the variance of the weight of the fuel if the expec- 
tation M[Q] = o. 

25.11 The altitude of a mountain peak H expressed in terms of the 
distance D on the slope and the inclination angle « is 


H = Dsine. 


Find the approximate value of the mean error in estimating the 
altitude if Ep = 80 m., EF, = 0.001°, and the most probable values are 
d = 12,300 m. and é = 31°.2, respectively. (The random variables D 
and e are independent and normal.) 

25.12 Let Z = sin XY, where X and Y are independent random 
variables. Find the approximate value of o, if x =y=0O, 
o, = oy = 0.001. 

25.13 The altitude of a mountain peak is given by the formula 
H = Dsine. The probability density of the errors in estimating the 
distance D on the slope and the inclination angle « is given by 


1 
d, So 
(4, «) D6 NOD 


| d—d\? e — é\? (d — dye — &) 
‘ exp { 195 ( og 7 ( O~ are Oq~ |} 
where og = 40 m., o, = 0.001 radians, d = 10,000 m. and é = 30°. 
Find the approximate value for the mean deviation of the errors made 
in estimating the altitude. 


25.14 The distance D, (Figure 29) is determined by a radar station 
whose errors have the mean deviation E, = 20 m. Distance D, can be 
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FIGURE 29 





determined either with a range finder, which gives errors with mean 
deviation Ep, = 40 m., or by the formula 


D, = VD? + a2. 


Find which method of determination of distance K.C is more 
accurate if the errors in estimating the distance between K, and K, 
have mean deviation E, = 50 m. 

25.15 Retaining the first three terms of the expansion of the 
function Y = g(X) ina Taylor series, find the expectation and variance 
of the random variable Y if X obeys a normal distribution law. 

25.16 The area of a triangle is given by the formula 


S= g sin y. 

Retaining all the terms of the Taylor series of the function 
S = 9(y) up to y® inclusive, find the expectation of the area of the 
triangle and the variance of its area caused by the dispersion of the 
angle if the random variable y is normally distributed, and 7 and 
D[y] are given. 

25.17 In the triangle ABC (Figure 30) the side a and the opposite 
angle « are random variables, which can be considered uncorrelated and 


B 


FIGURE 30 
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normal. Find an approximate value for the exectation X of the angle 
and its mean deviation if the base b is known and the expectations and 
mean deviations of the random variables a and « are known. 

25.18 A random variable X obeys the normal distribution law 


1 (x + 5)? 
PO) oae te eee } | 


Find an approximate value for the expectation and variance of the 
random variable Y = 1/X. Retain two and then three terms of the 
Taylor series. 

25.19 The radius of a sphere can be considered a normal random 
variable with expectation 7 and variance o? (7 > o,). Find the expec- 
tation and variance of the volume of-the sphere by using the exact 
formulas. Compare the results obtained with those of the linearization 
method. 

25.20 To determine the volume of a cone one measures (a) the 
diameter of the base and the height, (b) the diameter of the base and 
the length of the generator. In which of these two cases is the error in the 
determination of volume smaller if the expectation for the height is 
h = 8dm., for the diameter of the base d = 12 dm., for the length of the 
generator / = 10 dm. and o, = og = o, = 0.1 dm.? 

25.21 In a weighing process one uses a bar whose average 
diameter is 2 mm. What is the mean error if the mean deviation of the 
diameter of the roll is 0.04 mm. and the density of the metal of which 
the roll is made is 11.2 g./cc.? Fifty bars are used in the process of 
weighing. 

25.22 The acceleration g of gravity is computed by the formula 
g = 4n°L/T?, where L is the length of a physical pendulum, and 7, its 
period. Find the mean error in g if a measurement of the length of the 
pendulum with mean error EF, = 5mm. yields L = 5 m. and the measured 
period of oscillation is 4.5 sec. The period of oscillation of the 
pendulum is estimated for the duration of » = 10 complete displace- 
ments, measured with a mean error E, = 0.1 sec., and the mean error in 
determining the instant when the pendulum passes through a position 
of equilibrium is FE, = 0.5 per cent T. 

25.23 Using the linearization method, find an approximate value 
for the variance of the random variable Z = VkX? + Y®if ¥ = sin V, 
Y = cos V, the random variable V is uniformly distributed over the 
interval (0, 7/2) and k is a known constant. 








26. THE CONVOLUTION OF TWO-DIMENSIONAL AND 
THREE-DIMENSIONAL NORMAL DISTRIBUTION LAWS 
BY USE OF THE NOTION OF DEVIATION VECTORS 


Basic Formulas 


Any two-dimensional (three-dimensional) normal distribution law can be 
considered as the convolution of two (three) degenerate normal distribution 


146 FUNCTIONS OF RANDOM VARIABLES 


laws, describing the distribution of independent oblique coordinates of a ran- 
dom point in the plane (space) if the coordinate axes are chosen as conjugate 
directions of the unit distribution ellipse (ellipsoid).? 

A degenerate normal distribution law is uniquely characterized by a vector 
passing through the distribution center of this law, in the direction of one of the 
conjugate diameters of the unit ellipse, and equal in magnitude to this diameter. 
A vector defined in this way is called a deviation vector. 

The convolution of normal distributions in the plane (space) is equivalent 
to the convolution of deviation vectors. The convolution of normal distributions 
lying in one plane and given by deviation vectors a; (i = 1, 2,..., k) is formed 
according to the following rules: 

(1) the coordinates x, ¥ of the center of the compound distribution are 
given by the formulas, 

k k 
x = >, Xi, y = > Vis 
t=1 i=1 
where x;, y; are the coordinates of the origin of the deviation vector a;; 

(2) the elements k;; of the covariance matrix of the compound distribution 

are given by the formulas, 


1 < A 1 < C 
ka = 55 > Oh ==? koa = 55 D, = 55 


where q;, and q;, are the projections of the deviation vector a; on the axis of an 
arbitrarily selected unique rectangular system of coordinates; 

(3) the principal directions (&,7) of the compound distribution, their 
corresponding variances (07, 0?) and the angle a made by the axis Oé with Ox 
are determined by the formulas, 


o? = ky, cos? @ + ky sin 2« + koe sin? « 
l 


= qal4+ C+ V(A- CP + 487] 


= gal + C+ (A ~ C)sec 2a], 


oa? => ky sin? a + K10 sin 2a + ies cos? a 


= ZalA + C- VA CPF aR 
P 


= qal4+c-(4- C) sec 2a], 


1 If one chooses as conjugate directions the principal diameters of the ellipse (ellipsoid), 
the degenerate distribution laws characterize the distributions of independent rectangular 
coordinates of a random point. 
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FIGURE 31 





where «@ is any of the roots of the equation 


tan 2a = qo 


The principal semi-axes of the unit ellipse are 
a> opv2, b= o,pv 2. 


If a and 6 are the principal semi-axes of the unit ellipse, if m and n are 
two conjugate semi-axes of the same ellipse, if « and 8 are the angles made by 
n and m with the semi-axis a, and if 8 + a is the angle between the conjugate 
semi-axes, then in accordance with Apollonius’ theorem (Figure 31): 


m? + n? = a* + b*, 


mn sin (a + 8) = ab, 
where 
2 
tanotan B = 
é a?b? 


B+ (@ — By) sinta 


The convolution of deviation vectors in space is formed following the 
same rules. It is convenient to perform the necessary computations by using 
Table 9. 


TABLE 9 


Ki = Qix 


+ Ay + Qz 


A,+A2 
+Ag+2 
x (B,4+ B.+ Bs) 
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The elements of the covariance matrix ||k,,|| of the compound distribution 
law are determined by the formulas: 
A A A 
Ria ix ew? =o2 = =o = _3, 
Bi. 
2p? 


B. 
kog = ¢ kai = 53 ky. = 7p2 
The last two columns of Table 9 serve for checking the accuracy of compu- 


tations; the following equality must be satisfied: 
k 
2 KP = Ay + Ag + Ag + 2(B, + Bo + Bs). 
The variances £, 7, € with respect to the principal directions of the com- 
pound distribution ellipsoid (07, o?, o?7) are given by the formulas 
a : b2 ; C2 


= 5 3 ae cs eae Te 


where a, b, c are the principal semi-axes of the unit ellipsoid of the compound 
distribution, and are related to the roots (uw, ua, us) of the equation u® + pu + 
q = Oas follows: 


l 
a = Wy + 3? 
l 
bP = uz + 3° 


ce = Us + 


__lp _~_2 3,1 
p= 3/ +m, q= 57! + lm +n, 


l= A, + A, + As, 
m= A,Ag + AgA3 + A3A, = B? = B3 = B?, 
rza= A,B? + Ay B3 + A,B? a A, AgA3 = 2B, BoB3. 


The roots of the cubic equation can be found either from special tables or 
the formulas: 


ee ee p _ = p — 20 
un = 2) =1 pcos. UW, = 2 —3 Pp COS “—3— 


Us = 2,| =! pcos 242, 








where 
~9q 


cos ¢ = —=——:- 
* aV=3p8 
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The direction cosines of axes &, y, ¢ in the coordinate system Oxyz are 
the solutions of a system of three equations (i = 1, 2, 3): 


(A, — Ajay + Boag + Booyg = 0 
Bact, + (Ag — Aijoig + Byaig = O> 
af + of + af = 1 
where 
i =a, Ng Po. Age 0? 
and a, denotes the cosine of the angle made by the ith coordinate axis of the 
system Oénf with the jth axis of the system Oxyz. 


SOLUTION FOR TYPICAL EXAMPLES 


Example 26.1 The position of a point A is defined from a point of observa- 
tion O by distance OA = D, and the angular deviation from a reference line 
OB. 

The mean error in estimating the distance is 100k per cent of the distance; 
the mean error in estimating the angular deviation is e radians. The error made 
in representing the point A on a chart obeys a normal tircular distribution with 
mean deviation r; the error in the position of the point O also obeys a normal 
circular distribution law with mean deviation R. Find the compound distribu- 
tion characterizing the error in position resulting from the representation of 
point A on the chart. How will the probability that point A lies in a rectangle 
of size 100 x 100 sq. m. change if D decreases from 20 to 10 km. (r = 20 m., 
R= 40m,, e = 0.003, k = 0.005)? 


SOLUTION. Independent deviation vectors kD, r and R act along the 
direction of OA, and perpendicular to it there act the independent deviation 
vectors «D, rand R.? The distribution of the errors made in the position of A 
on the chart is defined by a unit ellipse with semi-axes 


Vk?D? +7? + R? and Ve2D? + r? + R?2, 


and, consequently, 


50 50 
Vk? D? + r? +R?) \We?D? + 7? + R? 
For distance OA = 20,000 m., 


¢/{ 50 \e/ 50 


If the distance becomes 10,000 m., 


¢ { 50 50 


2 Since the angle « is small, the deviation along the arc «D can be replaced by a devia- 
tion of magnitude ¢D along the tangent and one can consider this deviation perpendicular 
to the radius D. 
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Example 26.2 The position of a point K in the plane is defined by measur- 
ing the distance from it to two points M and N. The coordinates of the point 
obey a normal distribution law given by principal semi-axes a = 60 m. and 
b = 40 m., and angle «a, = 47°52’ between the semi-axis a and the direction of 
NK. 

How will the distribution of coordinates of point K change if the mean 
error for distance MK decreases to one-half? 


SOLUTION. The deviation errors of the coordinates of K arising from 
errors in the measurements of MK and NK are the conjugate semi-axes m and 
n of a unit ellipse, directed along the normals to MK and NK, respectively 
(see Figure 31). Therefore, « = 90°—a, = 42°8’. 


esto 2 OOP ae i a n = 48.0m 
~ b2 + (@ — By sin?a 5 ea: ie 
b? 
tan B = = 0.4913, B=26°10', «+f = 68°18’, 


a? tan « 


ab 


The principal semi-axes of the unit ellipse of the new distribution can be 
determined if one considers the fact that the conjugate semi-axes of this ellipse 
are the segments n/2 = 24.0 m. and m = 53.8 m., the angle between them being, 
as before, equal to « + 8 = 68° 18’. Using Apollonius’ theorem here, we obtain 


2 
ait bR= (5) + m*, a,b, = 5 msin (a + 8); 


that is, 
az + b? = 3470 sq. m., a,b, = 483.9 sq. m., 


a, = 58.3 m., bj. = 83m: 


Example 26.3 Find the covariance matrix of a three-dimensional! distribu- 
tion, representing the convolution of four degenerate normal! distributions with 
the following deviation vectors (Table 10): 


TABLE 10 












cos (a, x) | cos (a, y) | cos (a, z) 












1 0.5 —0.5 V3 0 
2 V0.4 V0.3 V0.3 
4 —0.8 0 —0.6 
4 0 I 0 





Find the principal semi-axes of the unit compound ellipsoid and the direc- 
tion cosines of the angles between the major semi-axes and the axes of co- 
ordinates. 
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SOLUTION. (1) The computation of the elements of the covariance matrix 
is given in Table 11. 


TABLE 11 


—17.32 
16.43 | 16.43 








Sum: 2060 + 1195 + 1170 + 2(270 + 1512 + 138.5) = 8265 


Check: 
kas = $5 = 4528, hg = HE = 267, has = $4 = 2572, 
Kos = x oa 593.5, ke, a a = 3323, Kis = = = 304.4. 


(2) The computation of the principal semi-axes of the unit compound 
ellipsoid proceeds as follows. 
According to the preceding formulas, we find 


1 = 4425; m = 3892-10°; nA = —8871-10%; 
p = —2635-10°; q = — 767-108; 
cos p = 0.4658; gp = 62° 14’ 20’; 





cos = 0.9352; cos# 5 ot =. 91608 
cos a Biel + zl = —0.7744; 
u, = 1752; lo = — 301.3; u, = — 1451; 
a= 3027° b? = 1174; é? = 24: 
a= 563: b = 34.3; c= 4,9, 


(3) The computation of the cosines of the angles made by the principal 
semi-axes a with the axes of coordinates proceeds as follows. 
We form the system of equations 


—1167«,, + 138015 + 151201, = 0, 
138a,, — 20320,. + 2700,, = 0, 


2 2 
at, + O12 + aig = I. 
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From the first two equations we find 


ayo = 0.16840, , a3, >= 0.756341; 
and from the third equation, 
oy, = +0.7905. 
Thus, 


cos (4, X) = a1, = +0.7905; cos (4, y) = a. = £0.1331; 
cos (4, Z) = @g = +0.5978. 


Similarly one can solve Problem 26.9. 


PROBLEMS 


26.1 Find the convolution of two deviation vectors ¢, and ¢, if 
the angle between them is y = 30°, c, = 30 m., cg = 40 m. and the 
distribution centers coincide. 

26.2 Solve the preceding problem for y = 0° and y = 90° 

26.3 Find the compound distribution that is the convolution of 
deviation vectors a;, lying in the same plane if their magnitudes are a;,, 
and the angles a, between a; and the positive direction of the axis of 
abscissas are given in Table 12. 


TABLE 12 









158°48’ 








1 30°37’ 

2 59°36’ 189° 3’ 
3 92°12’ 273°18’ 
4 127°17 316°54’ 





26.4 Find the unit ellipse of the compound variance law of the 
points in a plane obtained from the composition of the following 
deviation vectors lying in this plane (Table 13). 


TABLE 13 





26.5 Find the convolution of the deviation vector A (A = 18 m.), 
making an angle 8 = 75° with the direction of Ox, and a normal 
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distribution given by a unit ellipse, one of the semi-axes of which 
coincides with Ox and has length a = 30 m. and the other of which has 
length 5 = 20 m. 

26.6 Find the convolution of two normal distributions in the 
plane if (a) the principal semi-axes of the unit ellipses are a, = b, = 
50 m., d@2 = b2 = 25 m., (b) the principal semi-axes of the unit ellipses 
area, = 50m., 5, = 25m., a, = 50m., b, = 25 m. if the angle between 
a, and az is 30°. 

26.7 The coordinates of a random point in the plane obey a 
normal distribution law given by a unit ellipse with principal semi-axes 
a = 24m., b = 7m. Find the probability of hitting a diamond with side 
2/ = 60 m. and acute angle y = 34°.3. The center of the diamond co- 
incides with the center of the distribution and the adjacent sides of the 
diamond are parallel to two conjugate semi-axes. 

26.8 Find two deviation vectors equivalent to a normal distri- 
bution in the plane, characterized by a unit ellipse with principal semi- 
axes 80 m. and 60 m. if one of the deviation vectors makes an angle of 
30° with the major semi-axis. 

26.9 The coordinates of a ship are determined by a radar station, 
which estimates the distance from a reference point on the shore and 
the direction of the sighting. The errors in measurement are given by a 
unit ellipse with principal semi-axes £,, = 80 m. in the direction of the 
axis Ox, and E, = 30 m. in the direction of Oz. The unit ellipse of the 
errors made in estimating the coordinates of the reference point and 
caused by inaccurate knowledge of its position has major semi-axes 
E, = 100 m., E, = 40 m. and £, makes an angle of 20° with the axis 
Ox. 

Find (a) the probability density for the compound errors made in 
determining the position of the ship in the system of coordinates xOz, 
(b) the principal semi-axes and the orientation with respect to the axis 
Ox of the unit ellipse of the compound errors in the coordinates of the 

ship. 
26.10 The errors in determining the position of a ship at sea are 
due to three deviation errors, whose magnitudes and directions with 
respect to the meridian are given in Table 14. 


TABLE 14 





Find the unit ellipse of the errors in determining the position of the 
ship. 
26.11 Find the distribution law for the coordinates of a point C 
by sighting it from two points A and B if the base B, the angles 8, and 
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82 and the mean angular errors in sighting from both points E,, = 
Ej, = Eg, are given. The positions of A and B are known with certainty 
(Figure 32). 

26.12 Under the assumptions made in the preceding problem, 
compute the major semi-axes of the unit ellipse and its orientation with 
respect to direction AB for B = 15 km., 8; = 60°, By = 75°, Ey, = 
Ey, = 9.0005. 

26.13 Under the assumptions made in Problems 26.11 and 26.12, 
find the compound distribution law for the errors of coordinates of 
point C with respect to A if beside the errors in sighting E,, and E,,, 
there is given as well the distribution law for the errors in the position 
of point B with respect to A with the major semi-axes along the base 
E£, = 30 m. and perpendicular to the base FE, = 15 m. 

26.14 To determine the actual course of a ship and its velocity, 
one makes two estimates of the position of the ship (at the points A, 
and A.) with respect to some reference points located on the shore and 
during an interval of time 7 = 20 sec. The distribution of the errors in 
the position of the ship is circular with the radius of the unit circle 
r = 30 m. Find the mean error in estimating the magnitude of the 
velocity and the course of the ship if the distance A,Az2 is measured as 
D = 1000 m. 

26.15 The coordinates of a ship at time ¢ = 0 are known with an 
error obeying a normal circular distribution with the radius of the unit 
circle of 100 m. The mean error in the magnitude of the velocity is 
2 m./sec., representing 10 per cent of its velocity, and the mean error in 
estimating its course is 0.08 radians. Calculate the unit ellipse of the 
errors made in the position of the ship at time ¢ = 1 min. 

26.16 The position of a meteorological balloon at the instant of 
observation is known with an error obeying a normal spherical distri- 
bution law with the radius of the unit sphere equal to 50 m.; the velocity 
of the balloon is known with mean error 2 m./sec. The errors in finding 
the velocity vector in a plane perpendicular to its course are given by a 
normal distribution law with radius of the unit circle equal to 3 m./sec. 
Find the unit ellipsoid of the errors in the position of the balloon 
20 seconds after the coordinates and the velocity vector have been 
determined. 


FIGURE 32 
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26.17 Find the probability density for the sum of two random 
normal vectors in the space Oxyz, and a random vector in the plane 
Oxz, for which the first moments are 


Xy = 20, Vi — —10, 21 = —|5, 
Xo = 10, Je = 25, Zo = —40, 
Xs = 15, Zz; = —20, 


respectively, and the covariance matrices for the projections of the 
vectors on axes of coordinates are 


12 2 0 i 2 1 
IAP =}-2 8 If, tePi =] 2 8 —I, 
0 1 14 a A 

3. 0 -1 

[AP] =} 0 0 OF. 

-1 0 5 


The random vectors are mutually independent. 

26.18 Find the convolution of the deviation vector x, parallel to 
the axis Ox, x = 25, E, = 40 of a normal distribution in the plane xOy 
with the unit ellipse 

C2 io) aera Cis 10)" _ | 
400 900 


and the normal distribution in space with the unit ellipsoid 
(x = 10)? | (y= 10)? | 2? 
{00 ee 


if x, y, z are the rectangular coordinates of a point in space. 

26.19 Construct the covariance matrix of a system of three 
random variables (the coordinates of a point in space) that corresponds 
to the resultant of the following deviation vectors (Table 15): 


TABLE 15 


cos (a;, x) cos (a;, y) cos (a, Z) 





26.20 Under the conditions of the preceding problem, determine 
the major semi-axes of a unit joint distribution ellipsoid and the 
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FIGURE 33 





direction cosines of the angles between the greatest of the major semi- 
axes a and the coordinate axes. 

26.21 The position of a point Ky relative to a point K, is deter- 
mined on the basis of measured distances D, and D, from a point A 
and of the angle in the horizontal plane 7 K,BK2 = « (see Figure 33). 
Find the covariance matrix of the errors in the determination of the 
position of the point K, relative to the point K, if we know that the mean 
errors made in the determination of the distance are equal to Ep and 
those made in the determination of the angle are equal to E,. The 
measuring errors are mutually independent and they obey normal 
distribution laws. Assume that the altitude H of the point A over the 
horizontal plane K, BK, is known exactly. 

26.22 Solve Problem 26.21 with the hypothesis that we know 
(exactly), not the altitude H, but the angle « = 7 AK,B. 


V ENTROPY AND INFORMATION 


27. THE ENTROPY OF RANDOM EVENTS AND VARIABLES 


Basic Formulas 


Let A,, Ao,..., A, be a complete set of mutually exclusive events. 
Then the entropy of this set of events is defined as? 


Hee > P(A,) log, P(A,) 


and represents the average quantity of information received by knowing which 
of the events A, Ag,..., A, occurred in a certain trial. Thus, the entropy is a 
measure of uncertainty arising after performing trials involving a complete set 
of mutually exclusive events A, A2g,..., An. 

A similar formula defines the entropy H[X] of a discrete variable X, 
assuming values x,, X2,..., X, with probabilities p,, po,..., Pn: 


AX |= ~ 2, P log, p;- 


The same formulas hold for n = oo. 

The measure of uncertainty of a random variable X assuming a continuous 
series of values and having a given probability density f(x) is the differential 
entropy H[X], defined by the formula 


HLX] = - | © £0) lows f(x) dx, 


where f(x) log. f(x) = 0 for those values of x for which f(x) = 0. 
The conditional entropy of a random variable X with respect to a random 
variable Y is defined by 


H[X | yi] =D P(X = x; | Y = y;) log, P(X = x; | Y = yj) 
t=1 


for discrete ¥ and Y, and for continuous X and Y by the conditional differential 
entropy 


HIX| y] =— | fOe| ») los f(x |») de. 


1 P(A,) is the probability of event A,; P(A, log, P(A,) = 0 if P(A,) = 0. 
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We call the expectation of the conditional entropy the conditional mean entropy 
H,[X]. For discrete random variables 


H,[X] = M[H[X| y]] 


— 3 2,PCY = P(X = x1 | ¥ = y,) loge P(X = | ¥ = »), 


and for continuous random variables 


HX] = MUALX | yl =—]" [GONG 1») lowe Se | y) dx dy, 


Similar formulas hold for systems of random variables. For example, 


HUM, Xoo Kad = | ef ic eee 
x loge f(%1, Xa, .--> Xn) dX, +++ dx, 


represents the entropy of a system of » random variables, 


HAX,Y]=-[ | [ f@feey| 2) loge f(xy | 2) de dy de 


the conditional mean entropy of the subsystem (X, Y) with respect to Z and 


HeslZ1=—[" [fos |») lose fle | x») de dy de 


the conditional mean entropy of the random variable Z with respect to random 
variables X and Y. We also have the inequalities 


H[X, Y] = A[X] + A,1[Y] < A[X] + HY] 
and 


A(X, Xo, as | Xi] < 2 lhe; 


in which equality corresponds to the case of independent random variables. 

For a = 2, the unit of measure for entropy represents the entropy of a 
complete set of two mutually exclusive equally possible events. For a # 2 the 
value of the entropy computed for a = 2 must be multiplied by log, 2. The 
unit of measure for entropy is called binary for a = 2, decimal for a = 10, and 
so on, 


SOLUTION FOR TYPICAL EXAMPLES 


Example 27.1. A number of shots are fired at two targets: two shots at 
the first target and three at the second one. The probabilities of hitting a target 
in one shot are equal to 1/2 and 1/3, respectively. Which of the two targets 
yields a more certain outcome? 


SOLUTION. The outcome is determined by the number of hits scored, 
which obeys the binomial distribution law P(X = m) = C7p™(1 — p)"~™. 
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We form the distribution series of the first target for n = 2 and p = 1/2 
(Table 16), and of the second target for n = 3, p = 1/3 (Table 17). 


TABLE 16 





The entropy of the number of hits is a measure of the uncertainty of the 
outcome. For the first target, we have 


H,= —j log} — Slog 5 — rlog = 0.452 decimal units, 


ana for the second one 


1 l 2 2 4 4 8 8 : ; 
9 085 yi log 53 = 0.511 decimal units. 


Hy = — 55108 55 — Gg 1985 — 9 


The outcome in the case of the first target has a greater certainty. 


Similarly one can solve Problems 27.1 to 27.11. 


Example 27.2 Among all distribution laws of a continuous random 
variable X with the same known variation D, find the distribution with the 
maximal differential entropy. 


SOLUTION. According to a theorem in calculus of variations, to find a 
function y = y(x) that realizes an extremum of the integral 


b 
= { (x, y) dx 


under constraints 
b 
[ eesnde=c, = 1,2...,m), 


it is necessary to solve the Euler equation 


ad, _ 
oy 





0, 
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where O, = © + 5%, A,Y,, and constants A, are found from the given con- 
straints. In our example, we are looking for the maximum of the integral 


2 | fin fdx 
under the constraints 
| Pi 


and 
| (x — x)*fdx = D 
From this, it follows that 


D(x, f) = —fInf + af + A(x — x)7f. 
Consequently, the equation for f(x) has the form 
and, therefore, 
fla) = ce“ MO-*, 
where 
c= e7~Aitl. 
From the constraints, we find that 


1 l 
C= —___> =—_—- 
V22D * 2D 


The solution obtained corresponds to maximal entropy. 
Therefore, for a given variation D, the maximal entropy has the normal 


distribution law 
= 1 -. \2 
f(~) = aS exp {- 7D (x — x) }. 


Problems 27.12 to 27.15 can be solved in a similar manner. 


Example 27.3. Prove that the maximal entropy of a discrete random 
variable is log, n (7 being the number of possible values of the random variable) 
and is attained for py = po =--- =p, = I/n. 


SOLUTION. We shall make use of the inequality Inx > 1 — I/x (x > 0) 
(equality occurs only for x = 1). Applying this inequality, we obtain 


n 1 i 
_— > 2 Ta 
A + logan Pa Px 1OLa (MPx) 2 Ina 22 pe(I | 


= >h=1 Pr ao 1 = 0. 
Ina 
It follows that 


H=—) p, log. px < logan. 
k=1 


To the case np, = 1, there corresponds maximal entropy: log, 7. 
One can solve Problem 27.16 similarly. 
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PROBLEMS 


27.1 Two urns contain 15 balls each. The first urn contains five 
red, seven v, hite and three black balls; the second urn contains four red, 
four whit and seven black balls. One ball is drawn from each urn. Find 
the urn fi r which the outcome of the experiment is more certain. 

27.2 The probability of occurrence of an event is p, and of non- 
occurrene, g = 1 — p. For which value of p does the result of the trial 
have the naximal uncertainty? 

27.3. For which of the following two experiments does the outcome 
have the greatest uncertainty: (a) a random point is taken inside an 
equilater:il triangle and “‘success’’ means the point lands inside the 
inscribed circle; (b) a random point is taken inside a circle and 
““success”? means the point lands inside a given equilateral triangle 
inscribed in the circle. 

27.4 By joining the midpoints of adjacent sides of a regular 
n-polygon, one constructs another regular n-polygon inscribed in the 
first. A point taken inside the first polygon may turn out to be inside 
or outside the inscribed polygon. 

Find (a) the entropy of the experiment, (b) the value of x for which 
the entropy is maximal. 

27.5 The probability for realization of an event A at one trial is p. 
The trials are repeated until A occurs for the first time. Find the en- 
tropy of the number of trials and clarify the character of variation of 
the entropy with the change of p. 

27.6 Determine the entropy of a random variable obeying 
a binomial distribution law (a) in the general case, (b) for n = 2, 
p=q=0.5. 

27.7 Determine the entropy of a continuous random variable 
obeying (a) a uniform probability distribution over the interval (c, d), 
(b) a normal distribution law with variance of, (c) an exponential distri- 
bution of the form 


_ fee-* for x20 (c > 0), 
fe) = {9 for x <0. 


27.8 Find the entropy of a random variable X with a distribution 


function 
0 for x <0, 
F(x) = 4x? for O<x<l, 
L — forse 


27.9 Estimate the conditional differential entropy H[X | y] and 
the conditional mean differential entropy H,[X] of a random variable 
X with respect to Y, and also H[Y|x] and H,[Y] of the random 
variable Y with respect to X, for the system of normal random variables 

X, Y). 
ae Find the entropy of a system of nm random variables obeying 
a normal distribution law. 
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27.11 Given the entropies H[X] and H[Y] of two random 
variables X and Y, and the conditional mean entropy A,[X] of the 
random variable X with respect to Y, find the conditional mean 
entropy H,[Y] of Y with respect to X. 

27.12 Among all distribution laws of a continuous random 
variable X whose probability density vanishes outside the interval 
a <x < b, determine the distribution law with maximal differential 
entropy. 

27.13 Among all distribution laws of a continuous random 
variable XY whose probability density vanishes for x < 0, for a known 
expectation M[X] find the distribution law with maximal differential 
entropy. 

27.14 Find the probability density for which the differential 
entropy of a random variable is maximal if its second moment is mg. 

27.15 Among all the distribution laws for continuous systems of 
random variables with a known covariance matrix, find the distribution 
law for which the entropy of the system is maximal. 

27.16 A message is encoded by using two groups of symbols. 
The first group has & symbols with probabilities of occurrence pj, 
Pias+++> Pie (2f-1Pu = «), the second group has n symbols with 
probabilities of occurrence Doi, Poo,.--, Pon (D321 Po; = | — a). For 
a fixed value of «, find the probabilities p,; and p.,, corresponding to 
the maximal entropy. 

27.17 Experiment A consists of selecting an integer from 1 to 1050 
at random, experiment B of communicating the values of the remain- 
ders upon dividing the selected number by 5 and 7. Find the entropy 
of experiment A and the conditional mean entropy of A with respect 
to experiment B. 

27.18 Between two systems of random variables (X,, X2,..., Xn) 
and (Y;, Yo,..., Y,), there exists a one-to-one correspondence 
Y, = o(X1, Xo,.--, Xn)» Xe = v( Vi, Yo,..., Y,), where k = 1, 2, 
..., 4. Find the entropy H[Y,, Y2,..., Yn] if the probability density 


SfiA%1, Xo, -. +5 X,) 1S known. 
27.19 Two systems of random variables (X1, Xo,..., X,) and 
(Y1, Yo,..., Yn) are related by linear expressions 


re 2 aus X, (ne ee ee 
j= 


Evaluate the difference of the entropies, 
ALN, Ve 2k Y,] — A(X, Xo, .. “9 XI, 
(a) in the general case, (b) for n = 3 and the transformation matrix 


5 3 2 -1 
lal =|1 4-2]. 
0 -—3 5 


28. THE QUANTITY OF INFORMATION 163 


28. THE QUANTITY OF INFORMATION 


Basic Formulas 


The quantity of information obtained in the observation of a complete 
set of mutually exclusive events is measured by its entropy H; the quantity of 
information that can be obtained by observing the value of a discrete random 
variable X is measured by its entropy H[X]. 

The quantity of information about a random variable X that can be obtained 
by observing another random variable Y is measured by the difference between 
the entropy of X and its conditional mean entropy with respect to Y: 


I,[X] = H[X] — H,[X]. 
For discrete random variables, 


PLY = x| | 


1X] = M log, “At 


PU XS Y Sp) 
M) los. P(Y = x)P(Y = = 


= PCY = x;, Y = y;) 
P(Y = x, Y = y,) log, >: 
iz es Ys) 108 BUY = x)P(Y = »y,) 


I 
Me 


t 


If, after receiving a message about the discrete random variable Y, the value 
of the random variable X¥ is completely defined, then H,[X] =0 and 
L[X] = A[X]. 

If X and Y are independent, then H,[X] = H[X] and /,[X] = 0. 

For continuous random variables, 


Mio. £21] — mfiog, AU) 


els fy | ~ 8 ROME) 
pepe fc, y) 
=| fe» 108 F Gf(y) 


From the symmetry of the formulas defining the quantity of information 
with respect to X¥ and Y, it follows that 


1,[X] = 1,[Y]. 


SOLUTION FOR TYPICAL EXAMPLES 


Example 28.1 Using the method of Shannon-Fano,? encode an alphabet 
that consists of four symbols A, B, C and D if the probabilities of occurrence 


2 Jn the case of encoding by the method of Shannon-Fano, a collection of symbols 
(alphabet), originally ordered according to the decreasing probabilities of occurrence of 
the symbols, is divided into two groups so that the sums of the probabilities of the symbols 
appearing in each group are approximately equal. Each of the groups is then subdivided 
into two subgroups by using the same principle. The process continues until only one symbol 
remains in each group. Each symbol is denoted by a binary number whose digits (zeros 
and ones) show to which group a given symbol belongs in a particular division. 
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of each symbol in a message are: 
P(A) = 0.28, P(B) = 0.14, P(C) = 0.48, P(D) = 0.10. 
Find the efficiency of the code, i.e., the quantity of information per symbol. 


SOLUTION. We order the symbols of the alphabet according to the 
decreasing probabilities of C, A, B, D and then divide them successively into 
groups. 

In the first division, the first group contains C and the second A, B and D, 
since P(C) = 0.48 and P(A + B + D) = 0.52. We assign the coded symbol 1 
to the first group, and to the second, 0. Similarly, from the second group we 
obtain the subgroups A and B + D with probabilities 0.28 and 0.24, and with 
the codes 01 and 00. Finally, the group B + D is divided into B and D with 
probabilities 0.14 and 0.10, and codes 001 and 000. 

It is convenient to represent the coding process by Table 18. 


TABLE 18 







Codes of the 
Symbols of 
the Alphabet 


Symbols of | Probability | Subgroups 
the Alphabet of the and their 
Symbols Codes 


















C 0.48 }1 1 

A 0.28 }1 01 
B 0.14 ho Yo }1 001 
D 0.10 }0 000 


A complete set of mutually exclusive events corresponds to the occurrence 
of one symbol of the alphabet, and the total quantity of information in this 
particular example is the entropy of the alphabet. Therefore the quantity of 
information per coded symbol (efficiency of the code) equals the ratio of the 
entropy of the alphabet to the expected length of the coded versions of symbols: 


—0.48 log, 0.48 — 0.28 log, 0.28 — 0.14 log, 0.14 — 0.10 log, 0.10 


1-0.48 + 2-0.28 + 3-0.14 + 3-0.10 
1.751 


Similarly one can solve Problems 28.9 and 28.11 to 28.13. 


Example 28.2 The probabilities for a signal to be received or not received 
are « and & = 1 — a, respectively. As a result of noise, a signal entering the 
receiver can be recorded at its output with probability 8 and not recorded 
with probability 8 = 1 — B. In the absence of the signal at the input, it can be 
recorded at the output (because of noise) with probability y and not recorded 
with probability 7 = 1 — y. What quantity of information about the presence 
of the signal at the input do we obtain by observing it at the output. 


SOLUTION. Let X denote the random number of input signals, and Y the 
random number of output signals. 
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Then, 
P(X = 1) =a, P(X = 0) = 4, 
P(Y=1|X=l)=8, P(Y=0|X=)=8, 
P(Y=1|X=0)=y, P(¥=0|X=0)= 
PCY = 1) = of + ay, P(Y = 0) = of + ay. 


Ni 


This implies that 


L,[X] = a logs aa + é&y 1084 ae 








; B = 7 
log, — los, = 
TP GRORs ae &e 4 


One can also use the formula 
L{X] = .1Y] = #(Y] - #.1Y), 
where the unconditional entropy is 


H[Y] = —(of + @y) logs (@B + ay) — («8 + a7) log, (a8 + 47), 


and the conditional mean entropy is 


H,[Y] om — (8 log. B oF B log, B) _ aly log, y a ¥ loge J). 


Example 28.3 There are 12 coins of equal value; however, one coin is 
counterfeit, differing from the others by its weight. How many weighings, 
using a balance but no weights, are necessary in order to identify the counterfeit 
coin and to determine whether it is lighter or heavier than the rest. 


SOLUTION. Any of the 12 coins may turn out to be the counterfeit one 
and thus may be lighter or heavier than a genuine coin. Consequently, there are 
24 possible outcomes that, for equal probabilities of these outcomes, give as 
the entropy for the whole experiment used to identify the counterfeit coin the 
value log, 24 = 3 + log, 3 = 3 + 0.477/0.301 = 4.58. 

Each weighing process has three outcomes, which under the assumption of 
equal probabilities give an entropy equal to log, 3 = 1.58. 

Therefore, the minimal number of weighings cannot be smaller than 
logs 24/log, 3 = 4.58/1.58 = 2.90; 1.e., it is at least three. In fact, it will be 
shown that for an optimal planning of the experiment, exactly three weighings 
will be necessary. 

In order that the number of weighings is the minimum, each weighing 
must furnish the maximal quantity of information and, for this purpose, the 
outcome of a weighing must have maximal entropy. 

Suppose that in the first weighing there are / coins on each of the two pans. 
As mentioned previously, in this case three outcomes are possible: 


(1) the pans remain in equilibrium; 
(2) the right pan outweighs the left; 
(3) the left pan outweighs the right. 
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For the first outcome, the counterfeit coin is among the 12 — 2i coins put 

aside and, consequently, the probability of this outcome is 

oe Soe! 

AD 


For the second and third outcomes, the counterfeit coin is on one of the 
pans. Thus, the probabilities of these outcomes are 


Py 


i 
P2 — Pz = 12° 
In order that a weighing give the maximal information, the probability 
distribution of the outcomes must have maximal entropy, which means that 
all probabilities must be equal. From this, it follows that 


i.e., In the first weighing process, four coins should be placed on each pan. 

Next, we consider separately the following two cases: (a) in the first 
weighing, the pans remain in equilibrium, (b) one of the pans outweighs the 
other. 

In case (a) we have eight genuine coins, and four suspect coins that are not 
used in the first weighing. For the second weighing, we can place i suspect 
coins on the right pan (i < 4) andj < i suspect and i — j genuine coins on the 
left pan. In this case i + j < 4, since the number of suspect coins is 4. All 
possible values for i and j and the corresponding probabilities of the outcomes 
in the second weighing in case (a) are included in Table 19. 





TABLE 19 
Experiment j P, P» Ps Hy 
number 
1 1 J 0.5 0.25 0.25 0.452 
2 1 0 0.75 0.125 0.125 0.320 
3 2 2 0 0.5 0.5 0.30! 
4 2 1 0.25 0.375 0.375 0.470 
5 2 0 0.5 0.25 0.25 0.452 
6 3 1 0 0.5 0.5 0.301 
7 3 0 0.25 0.375 0.375 0.470 
8 4 0 0 0.5 0.5 0.301 


In this table, the entropy of the experiment is also given. It is 
Hi; = —P, log P; — Pz log P», — Pz log Pg. 


The maximal entropy is given by experiments 4 and 7. Thus, there are two 
equivalent versions of the second weighing: it is necessary either to place two 
suspect coins on one pan and, on the other, one suspect and one genuine coin 
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(experiment 4); or to place three suspect coins on one pan and three genuine 
coins on the other (experiment 7). 

In both versions, the third weighing solves the problem; that is, it identifies 
the counterfeit coin and determines whether it is lighter or heavier than the 
rest. 

In case (b), in which one of the pans outweighs the other in the first weighing, 
the coins are divided into the following three groups: four suspect coins, which 
are placed on the right pan; four suspect coins on the left pan (4 “‘right”’ and 
4 “left”’); and four genuine coins, which are not used in the first weighing. 

If, in the second weighing, one places i, “‘right”’ and i, “left”? coins on the 
right pan, j, “‘right,” j. “left” and i, + ig — j; — je genuine coins on the left 
pan and then compares the entropy of all the possible versions, there will be 13 
equivalent versions with maximal (equal) entropy. Any of these versions, for 
example, i, = 3, ig = 2,7; = 1, fg = 0 or i, = 1, 2 = 2, j, = 0, jo = 2, gives 
maximal information and permits us to identify the counterfeit coin, in the 
third weighing and to find out whether it is lighter or heavier than the rest. 

Problems 28.2 and 28.5 can be solved in a similar manner. 


PROBLEMS 


28.1 A rectangle is divided into 32 squares by four vertical and 
eight horizontal lines. A point can be inside any one of these squares with 
equal probability. 

Find the quantity of information in the messages that (a) the point is 
in square 27, (b) the point lies in the third vertical and the first horizontal 
line, (c) the point lies in the sixth horizontal line. 

28.2 There are N coins of equal value, of which one is counterfeit, 
that is, lighter than the rest. 

How many weighings, on a balance without weights, are necessary 
to identify the counterfeit coin? What is the maximal N for which five 
weighings are sufficient ? 

28.3 The symbols of the Morse Code can appear in a message with 
probabilities 0.51 for a dot, 0.31 for a dash, 0.12 for a space between 
letters and 0.06 for a space between words. Find the average quantity 
of information in a message of 500 symbols if there is no relation 
between successive symbols. 

28.4 A composite system can be in one of N equally probable 
states A,. The state of the system can be determined by performing some 
control experiments, the result of each showing the group of states in 
which the system can be. 

In one of the experiments a signal is observed in the states A,, Ao, 
..., Ay, and not observed in states A,+1, Ax+2,..-, Ay. In another ex- 
periment, the signal is observed if the system is in one of the states 
A,, Ao, -.-> A, I< k) or Anais Acsar+++> Aner & < N — k) and not 
observed in the rest. What is the quantity of information in the first and 
second experiments ? 

28.5 A defective television set can be in one out of five different 
states, to which there are corresponding different types of failures. To 
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identify the type of failure, one performs several tests out of a total of 
seven possible tests, which for different states of the television set make 
a control light bulb turn on or off. In the following table, these states are 
denoted by ones and zeros. 


State No. 


Test No. 





Find a sequence consisting of the minimal number of tests that 
permit determination of the type of failure. 

28.6 Some messages use the symbols of the alphabet A,, Ag, As, Ag 
with probabilities P(A,) = 0.45, P(A.) = 0.10, P(A3) = 0.15, P(A,) = 
0.30. 

To transmit a message through a communication channel, one can 
use two codes, | and 2. In the first code, the symbols a, b, c and d and 
in the second code, the symbols a, d, b and c correspond to the symbols 
of the alphabet. 

Determine the efficiency of the codes, i.e., the average quantity of 
information transmitted per time unit, if the transmission times of the 
symbols of the code through the communication channel for conven- 
tional] time units are 


t, = 8, th = 6, i= 5, fg = 3. 


28.7 Under the assumptions made in the preceding problem, 
along with codes I and 2, consider other possible codes and find the 
most efficient one. 

28.8 For the transmission of some messages, one uses a code of 
three symbols whose probabilities of occurrence are 0.8, 0.1 and 0.1. 
There is no correlation among the symbols of the code. Determine the 
redundancy of the code; that is, the difference between | and the ratio 
of the entropy of the given code to the maximal entropy of a code 
containing the same number of symbols. 

28.9 A message consists of a sequence of two letters A and B, 
whose probabilities of occurrence do not depend on the preceding letter 
and are P(A) = 0.8, P(B) = 0.2. 

. Perform the coding by using the method of Shannon-Fano for 
(a) separate letters, (b) blocks consisting of two-letter combinations, 
(c) blocks of three-letter combinations. 

Compare the codes according to their efficiency. 


28. 
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28.10 Compare the codes of the preceding problem according to 
their redundancy by calculating the mean probabilities of occurrence 
of the symbol a; by the formula 


Dae 1 P(A)Z;; , 
i= 1 P(A)R; 


where Z;; is the number of symbols a; in the ith coded combination, 
and R;, is the number of all symbols in the ith combination. 

28.11 A message consists of a sequence of letters A, B and C, 
whose probabilities of occurrence do not depend on the preceding 
combination of letters and are P(A) = 0.7, P(B) = 0.2 and P(C) = 0.1. 

(a) Perform the coding by the method of Shannon-Fano for 
separate letters and two-letter combinations ; (b) compare the efficiencies 
of the codes; (c) compare the redundancies of the codes. 

28.12 The probabilities of occurrence of separate letters of the 
Russian alphabet are given in Table 20, where the symbol ‘‘—”’ 
denotes the space between words. 

Perform the coding of the alphabet by the method of Shannon- 
Fano, if the probability of occurrence of a letter is independent of the 
occurrences of the preceding letters. 


P(a,;) = 


TABLE 20 

Letter H c 
Probability 0.053 | 0.043 
Letter TI y 
Probability 0.023 | 0.021 
Letter y ii 
Probability 0.012 | 0.010 
Letter 3 o 

pe ee fe a 
Probability 0.003 | 0.002 





28.13 An alphabet consists of m symbols A; (j = 1,2,...,n) 
whose occurrences in a message are independent and have probability 


P(A;) = Pima 
where k, are positive integers, and 

> P(A) = 1. 

j=l 


Show that if one codes this alphabet by the method of Shannon- 
Fano, each coded symbol contains a maximal quantity of information 
equal to one binary unit (one bit). 
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28.14 Two signals, A, and Ag, are transmitted through a com- 
munication channel with the probabilities P(A,) = P(A.) = 0.5. At 
the output of the channel the signals are transformed into symbols 
a, and a, and, as a result of noise to which A, and A, are subjected 
equally, errors appear in transmission so that an average of one signal 
out of 100 is distorted (a, becomes a, or az becomes a;). 

Estimate the average quantity of information per symbol. Compare 
it with the quantity of information in the absence of noise. 

28.15 Signals A, Ao,..., A, are transmitted with equal prob- 
abilities through a communication channel. In the absence of noise, 
the symbol a, corresponds to the signal A, (j = 1, 2,..., m). In the 
presence of noise, each symbol is correctly received with probability 
p and is distorted to another symbol with probability g = 1 — p. 
Evaluate the average quantity of information per symbol in the cases 
of absence and of presence of noise. 

28.16 Signals A,, Ag,..., A, are transmitted through a communi- 
cation channel with equal probabilities. In the absence of noise, the 
symbol a, corresponds to the signal A; (j = 1, 2,..., m). Because of the 
presence of noise, signal A, can be received correctly with probability 
Pj; or as symbol a; with probability p,, (i,j = 1,2,...,m, >71 py = 1). 
Estimate the average quantity of information per symbol that is trans- 
mitted through the channel whose noise is characterized by the matrix 


Il pis. 


V | THE LIMIT THEOREMS 


29. THE LAW OF LARGE NUMBERS 


Basic Formulas 


If a random variable X has a finite variance, then for any e > 0, Cheby- 
shev’s inequality holds: 
DIX] 


e2 





P(X —z| 26) < 


If X,, Xo,..., X_... is a sequence of random variables, pairwise indepen- 
dent, whose variances are bounded by the same constant DLY,] < C,k = 1,2, 
., then for any constant e > 0, 


k=1 k=1 


lim P( 
(Chebyshev’s theorem). 


If the random variables X,, Xo,..., X,... all have the same distribution 
and have finite expectations x, then for any constant e > 0, 


Him P( [7 Xe 5 <e) =I 
A Y= 


nm 7>@ 











(Khinchin’s theorem). 


For a sequence of dependent random variables X,, X2,..., Xn,---; 
satisfying the condition 
> =, 
Ms n? >| > x 


for any constant e > 0, we have 


: x 1 < 
fim PAE > Xe — 5 2] < ef = 
(Markov’s theorem). 
In order that the law of large numbers be applicable to any sequence of 








dependent random variables X,, X2,..., X,,.-., 1-e., for any constant e« > 0, 
for the relation 

lim PA; Sis > < ebm 

noo n kel n kel 
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to be fulfilled it is necessary and sufficient that the following equality hold true: 


{E> Oe a} 
me 14 > ao} 


SOLUTION FOR TYPICAL EXAMPLES 


Example 29.1 Prove that if g(x) is a monotonic increasing positive func- 
tion and M[g(X)] = m exists, then 
m 
P(X > t)<—~:- 
ey Ge) 
SOLUTION. Taking into account the properties of p(x), we obtain a chain 
of inequalities 


P(Y > t) = | jouw { eCoroy a 
x>t p(t) x>t 
1 [- m 
<— x) f(x) dx = —~> 
CO) fag OI a) 
since m = M[p(X)] = [7° p(x) f(x) dx. This implies that PLY > t) < m/9(:), 
which we wish to prove. 
Similarly one can solve Problems 29.2 to 29.5. 


Example 29.2 Given a sequence of independent random _ variables 
X,, Xo,..., Xn»... With the same distribution function 


F(x) = ; + * arctan, 


determined whether Khinchin’s theorem can be applied to this sequence. 
SOLuTION. For the applicability of Khinchin’s theorem, it is necessary 
that the expectation of the random variable YX exist; i.e., ies x dF (x)/dx dx 
converge absolutely. However, 
+o foe) A 
ix] SO ae = = f x dx = ii | x dx 


m Reames 
dx WT 0 x? + qa? A>o 7 9 x7 + a? 





I 
= 
=i 


a. ( “) 
1+ =z) =0, 
WT A> a 
i.e., the integral does not converge, the expectation does not exist and Khinchin’s 
theorem is not applicable. 
Example 29.3 Can the integral J = i (sin x)/x dx (a > 0), after the 


change of variables y = a/x, be calculated by a Monte-Carlo method according 
to the formula 


=1 Vk Vk 
where y, are random numbers on the interval [0, 1]? 
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SOLUTION. Performing the previously mentioned change of variables, we 
obtain 


1 
r= Pe 
oy y 


The quantity J, can be considered an approximate value of J only if the 
limit equality lim, P(|J, — J| < e«) = 1 holds true. 

The random numbers y, have equal distributions and, thus, the functions 
(1/y,) sin (a/y,) also have equal distributions. To apply Khinchin’s theorem, 
one should make sure that the expectation M[(1/ Y) sin (a/ Y)] exists, where Y 
is a random variable uniformly distributed over the interval [0, 1]; i.e., one 
should prove that I . (1/y) sin (a/y) converges absolutely. 

However, if we denote by s the minimal integer satisfying the inequality 


5S > afr, then 
ait = isin 2 x| et [sin x] x| 
= sin =. a = I dx [" dx 
{, y yi 4 >> 





k=s V0 
Since 
7 siny < 1 o. ee oe 
2 ), y + kn . 2 ae a 1) 0 syd ele + 1 eis 

the integral diverges too, 

iE i d 

— sin —| dy. 
o | y 4 








The latter means that M[(I/ Y) sin (a/ Y)] does not exist and, consequently, 
the Monte-Carlo method is not applicable in this particular case. 


Example 29.4 Can the quantity 
=) > (i= 
Neri 


be taken as an approximate value of the variation of errors given by a device 
if X,, Xo,..., Xn)... are independent measurements of a constant quantity a 
and if they all have the same distribution functions? 


SOLUTION. Let us denote the true value of the variance by o?. The quantity 
S? can be considered as an approximate value for o? if 


lim P{|S2 — 02] < e} = 


Since Y,, Xo,.--; Xn,--. are independent random variables with equal distri- 
butions, the variables Y,, = (X,, — a)? are independent and have equal distri- 
butions. 
We have 
M[Y,.] = M[(%,. — 2?) = M[XZ] — 2aM[X,] + a? = 0? + X? — 2ax + a? 
a? + (x _ a)’, 


il 
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where * = M[YX,]. To satisfy the equality M[Y,,] = o?, it is necessary that 
x = a, which means absence of systematic errors in measurements. 

Thus, if the measuring device does not give systematic errors, the conditions 
for applicability of the law of large numbers are satisfied and, consequently, 


lim Pf <eh =i. 





1S (% — a? -— 
a 





PROBLEMS 


29.1 Use Chebyshev’s inequality to estimate the probability that 
a normal random variable will deviate from its expectation by more 
than (a) four mean deviations, (b) three mean-square deviations. 

29.2 Prove that for any random variable X and any e > 0, the 
following inequality holds: 


P(eX > t? + InJ) < e7®, 
where J = M[e**]. 
29.3 Prove that if M[e**] exists, 
PCY > e) < e~™M[e™*] (a > 0). 


29.4 Arandom variable X obeys the exponential distribution law 
= x" —x > 0 
f() = mie (x > 0). 
Prove that the following inequality holds true: 


m 

29.5 The probability of occurrence of an event A in one experi- 
ment is 1/2. Can one assert that with probability greater than 0.97 the 
number of occurrences of A in 1000 independent trials will be within the 
limits of 400 to 600? 

29.6 Is the law of large numbers valid for the arithmetic mean 
of n pairwise independent random variables X,, specified by the distri- 
bution series in Table 21? 


TABLE 21 





29.7 Let X; be a random variable that can assume with equal 
probability one of two values, k* or —k°‘. For which value of s does the 
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law of large numbers apply to the arithmetic mean of the sequence of 
independent random variables X,, Xo,..., X,,...? 

29.8 Prove that the law of large numbers is applicable to the arith- 
metic mean of a sequence of independent random variables X, specified 
by the distribution series included in Table 22. 


TABLE 22 





29.9 Are the sufficient conditions satisfied for the applicability of 
the law of large numbers to a sequence of mutually independent random 
variables X; with distributions specified by the formulas: 


(a) P(X, = £24) = 5; 
(b) P(X, = +2") = ia P(X, = 0) = 1 — 2°-*; 
(c) P(X, = +k = i P(X, = 0) = 1-9 


29.10 The random variables X,, Xo,..., X,,... have equal 
expectations and finite variations. Is the law of large numbers applicable 
to this sequence if all the covariances ki, = M[(X; — x) x (X; — x) 
are negative ? 

29.11 Prove that the law of large numbers is applicable to a 
sequence of random variables in which each random variable can 
depend only on random variables with adjacent numbers, and all the 
random variables contained in the sequence have finite variances and 
expectations. 

29.12 A sequence of independent and equally distributed random 
variables X,, Xo,..., X;,... is specified by the distribution series 


P(Y,=k) = (ES 298: 


1 
k°C(3) 
where €(3) = Dy_1 1/k® = 1.20256 is the value of the Riemann function 
for argument 3. Is the law of large numbers applicable to this sequence? 

29.13. Given a sequence of random variables X,, X2,..., X;,..., 
for which D[X,] < c and r,;—> 0 for |i — j| > © (7, is the correlation 
coefficient between X;, and X;), prove that the law of large numbers 
can be applied to this sequence (Bernstein’s theorem). 

29.14 A sequence of independent and equally distributed random 
variables X,, Xo,..., X;,... 18 specified by the distribution series 


6 
P(X, = (—D*-1k) = Gat as Oe ea 


determine whether the law of large numbers applies to this sequence. 
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30. THE DE MOIVRE-LAPLACE AND LYAPUNOV THEOREMS 


Basic Formulas 


According to the de Moivre-Laplace theorem, for a series of n independent 
trials in each of which an event A occurs with the same probability p(0 < p < 1), 
there obtains the relation: 


ii P( < 2 <0) = =|. cP dt = 5 [Ob ®(a)), 
Jim Pla < 7 T= [b(b) — O(a) 





where m is the number of occurrences of event A in nv trials and 


O(x) = Ee == | e~ 7/2) dt 


is the Laplace function (probability integral) whose values are included in 8T 
in the table list on page 471. 

According to Lyapunov’s theorem, for a sequence of mutually independent 
random variables X,, Xo,..., X;,... Satisfying for some 5 > 0 the condition 


1 
lim ava > M{|X,, — a,|?*9} = 0, 
the following — holds: 
tim nP(a <5 ere > 6 ee oe b) = [ em dy — 1 5 106) _ o@)], 
where xX, = Mies is the expectation of X,, 02 = D[X;,] is the variance of X,, 
2 


> Deel OR. 


To prove that Lyapunov’s theorem is applicable to equally distributed 
random variables, it is sufficient to show that the variances of the terms are 
finite and different from zero. 


SOLUTION FOR TYPICAL EXAMPLES 


Example 30.1 The probability that an item will fail during reliability 
tests is p = 0.05. What is the probability that during tests with 100 items, the 
number failing will be (a) at least five, (b) less than five, (c) between five and ten. 


SOLUTION. By the de pee abit theorem, 
; M2 — Mp m, — np 
( 1 2) & Vie Vnpq 
if is sufficiently large. By assumption, n = 100, p = 0.05, g = 1 — p = 0.95. 
(a) The probability that at least five items fail is 
100 — 5 5-5 
Oe ve V4.75 V4.7 
5 [0(43.6) — ®O)] = 0.5. 





NolL— 
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(b) The probability that less than five items fail is 


Pim <5) =Po<m<5x}(0(5=8) - o(2=)] 


= ; [®(0) + (2.29)] = 50.9780 = 0.489. 


(c) The probability that five to ten items fail is 


P(S <m< 10) x ; [o(S=) 7 “(R)| 


= 5 (02.29) — 0(0)] = 50.9780 = 0.489. 





Problems 30.1 to 30.4 can be solved similarly. 


Example 30.2 How many independent trials should be performed so 
that at least five occurrences of an event A will be observed with probability 0.8, 
if the probability of A in one trial is P(A) = 0.05. 


SOLUTION. From the de Moivre-Laplace theorem, we see that 
1 n — 0.05n 5 — 0.05n 
( ao V'0.0475n V/0.0475n 
5- <=) 


-} [o(4.36v7) = oa 


For n = 1, we have 0(4.36Vn) ~ 1; therefore, substituting P(m > 5) = 0.8, 


we obtain 
1 5 — 0.05n 
2 ace 02 =) ~ 0.8 
2 V0.0475n 


5 — 0.05n 
(aparsa) 
From 8T in the table list on page 471, we find the argument x = —0.8416 
corresponding to the value of the function O(x) = —0.6. Solving the equation 
5 — 0.05n 

V'0.0475n 

we find the unique root » = 144. Thus, in order that A occur at least five times 


with probability 0.8, 144 trials are necessary. 
Following this example, one can solve Problems 30.5 to 30.7. 





or 
= —0.6. 


= —0.8416, 


Example 30.3 How many trials should be performed to calculate the 
integral 
7/2 
t= i cos x dx 


Oo 


by a Monte-Carlo method so that with probability 0.9 the relative error in 
calculating the value of the integral is less than 5? 
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SOLUTION. The integral (2/7)J = (2/7) (ies cos x dx can be looked upon 
as the expectation of the function cos x of the random variable X, uniformly 
distributed over the interval (0, 7/2). Then the approximate value of the integral 
is 


where X,, are random numbers on the interval (0, 7/2). 
Let us form the random variable 








a 
" VDI) 
which according to Lyapunov’s theorem has the distribution function 
1 
t= — em (712) 
V2 


because the variables cos X; are independent and equally distributed, with a 
finite variance different from zero, and J = M[J,]. We have 
(Siaee se 


8n 





ved 
D[J,] =< Dicos X] = 


Applying Lyapunov’s theorem, for b = —a = e we get 


8n 


consequently, it follows that e = 1.645. 
In order that the relative error (J, — J)/J be less than 0.05, since J = 1, 
it is necessary to perform n trials so that 


8n 


thus, we obtain n > 252. 
Similarly one can solve Problems 30.10 to 30.12. 


PROBLEMS 


30.1 The probability of occurrence of an event in one trial is 0.3. 
What is the probability that the relative frequency of this event in 100 
trials will lie within the range 0.2 to 0.4? 

30.2 There are 100 machines of equal power operating indepen- 
dently so that each is turned on during 0.8 of the entire operating time. 
What is the probability that at an arbitrary instant of time, 70 to 86 
‘machines will be turned on? 

30.3. The probability that a condenser fails during a time T is 0.2. 
Find the probability that among 100 condensers during time T (a) at 
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least 20 condensers, (b) fewer than 28 condensers, (c) 14 to 26 condensers 
will fail. 

30.4 Using the de Moivre-Laplace theorem, show that for a 
sufficiently large number of trials, 

P(p~e<™<pte) x (2) = 02), 
n pv 2pq VPq 
where m/n is the frequency of occurrence of the event whose probability 
of occurrence is p. 

30.5 The probability of an event is evaluated by a Monte-Carlo 
method. Find the number of independent trials that insure with 
probability at least 0.99 that the value of the required probability will 
be determined with an error not exceeding 0.01. Apply Chebyshev’s 
and Laplace’s theorems. 

30.6 The probability that an item selected at random is defective 
in each test is 0.1. A lot is rejected if it contains at least 10 defective 
items. How many items should be tested so that with probability 0.6 
a lot containing 10 per cent defective items will be rejected? 

30.7 How many trials are necessary so that with probability 0.9 
the frequency of a given event will differ from the probability of occur- 
rence of this event by at most 0.1 if the probability of the event is 0.4? 

30.8 The probability of occurrence of a certain event in one trial 
is 0.6. What is the probability that this event will appear in most of 60 
trials? 

30.9 The probability of event A is 1/3 and 45,000 independent 
trials are performed. What is the mean deviation E of the number of 
occurrences of event A from the expectation of this number? 

30.10 The calculation of the integral J = [ x? dx is made by 
a Monte-Carlo method based on 1000 independent trials. Evaluate the 
probability that the absolute error in the estimate of J will not exceed 
0.01. 

30.11 How many trials should be performed to calculate the 
integral 

n{2 
: { sin x dx 
(0) 
by a Monte-Carlo method so that with probability P > 0.99 the 
absolute error of the computed value will not exceed 0.1 per cent of J? 

30.12 The probability P(C) =P(A + B), where P(B| A) is 
known, is estimated by a Monte-Carlo method in two ways: (1) the 
approximate value of P(C) is found as the frequency of occurrence of 
the event C in a series of n independent trials, (2) the frequency m/n of 
occurrence of the event A in a series of n independent trials is found and 
the approximate value of P(C) is evaluated by the formula 


P(C) = P,(C) =< s (1 2 "PCB | 4). 


(a) Prove that both ways lead to the same result, (b) find the 
necessary number of trials in each case so that the error in the estimate 
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of P(C) does not exceed 0.01 with probability 0.95, if P(B | A) = 0.3 
and the value of P(A) is of order 0.4. 

30.13 There are 100 urns containing five red and 95 black balls 
each. The experiment is such that after a ball is drawn it is returned 
to the same urn and the outcome of the trial is not communicated to 
the observer. How many trials should be performed so that (a) the 
probability is 0.8 that at least one red ball is drawn from each urn, 
(b) the probability is 0.8 that at least one red ball is drawn from at least 
50 urns? 

30.14 Compute the characteristic function Ey (u) of the random 


variable 
y, = Diy (X; _ Xi) 
_ = ie 
Vv >f1 DIX] 
and find its limit for n ~ oo if the random variables X,, Xo,..., Xn» - 


are independent and have equal probability densities or distribution 
series of the form: 


1 

= for |x,| <A, 
(a) fu) = 42h Ix 

O for |x| > A; 
(b) P(X, = m) = Ses; 

0 for x; < 0, 
(c) f(a) = 


{s4 
cia e-Te- BX! for x) S0. 


T'(«) os 


30.15 Find the limit for n—oo of the characteristic function 
Ey, (u) of the random variable 


= dhe (X; — Xi) 
V>E1 DX] 
if the random variables X,, X2,..., Xn,... are independent, have equal 


distribution laws, expectations and variances, and the moments of 
higher order are bounded. 


n 


V al THE CORRELATION THEORY 
OF RANDOM FUNCTIONS 


31. GENERAL PROPERTIES OF CORRELATION FUNCTIONS 
AND DISTRIBUTION LAWS OF RANDOM FUNCTIONS 


Basic Formulas 


A random function of a real variable ¢ is a function X(t) that for each ¢ 
is a random variable. If the variable t can assume any values on some (finite 
or infinite) interval, then the random function is called a stochastic process; 
if the variable ¢ can assume only discrete values, X(t) is called a random 
sequence. 

The (nonrandom) function x(t), which for each ¢ is the expectation 
M[X(¢)] of the random variable X(t), is called the expectation of the random 
function X(f). 

The correlation (autocorrelation) function K,(¢,, t2) of the random function 
X(t) is defined by the formula, 


K,(t1, t2) = M{[X*(4q) — X*(tD NIX) — X(t2)]}} = KF(t2, 4), 
where * denotes the complex conjugate.+ 
For stationary random functions we have 
K.Ati, tz) = K.t2 — th), X(t) = const. 


The variance of the ordinate of a random function is related to K,(t;, to) by 
the formula DLX(t)] = o2¢ = K,(t,, to). The normalized correlation function 
is defined by the formula 


K,(t,, to) M 


O x(t )F x(te) 


k,{ti, te) = 


The total character of a random function is given by the collection of 
distribution laws 
S(% | ty), f(x, X2 | hh, to), f(x; Xo, X3 | hh, ta, ts), sey 


where f(x,,..., Xn | ti,-.-,¢n) iS the density of the joint distribution of the 
values of the random function at times (fj, fo, f3,-.-, ¢,). The expectation x(t) 


1 When not otherwise specified, X(¢) is real. 
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and correlation function K,(t,, t2) are expressed in terms of the functions 
F(x1 | t1:) and f(x, x2 | f1, t2) by the formulas (for continuous random functions)? 


x(t) = iz xf(x | t) dx, 


K,(t,, to) a ii | X1X2f(*1, X2 | ths to) dx, dX» = X(t) X(t). 


For a normal stochastic process, the joint distribution at n times is com- 
pletely defined by the functions x(t) and K,(t,, t.) by the formulas for the distri- 
bution of a system of normal random variables with expectations 


x(t), X(te), X(ts), ec X(tn), 


and whose elements of the covariance matrix are k,, = K,(t;,t), l, j = 1, 
PS 

The mutual correlation function R,,(¢;, t2) of two random functions X(t) 
and Y(t) is specified by the formula 


Rayltr, te) = MU[X*(h) — X*@)ILY G2) — ta) ]} = RE te, 4). 


For stationary processes, 
Rey(tr, to) = Ryy(te oe. ty). 


The notion of correlation function extends to random functions of several 
variables. If, for example, the random function X(€,7) is a function of two 
nonrandom variables, then 


K,{€,, £95 Nis 2) = M{[X*(é,, ”1) _ x*(E,, mi )ILX (Ee, n2) = X(Eo, no) I}. 


SOLUTION FOR TYPICAL EXAMPLES 


The problems of this section are of two types. Those of the first type ask 
for the correlation function of a random function and for the general properties 
of the correlation function. In solving these problems one should start directly 
from the definition of the correlation function. The problems of the second 
type ask for the probability that the ordinates of a random function assume 
certain values. To solve these problems, it is necessary to use the corresponding 
normal distribution law specified by its expectation and correlation function. 


Example 31.1 Find the correlation function K,(t,, t.) if 


X(t) = 


j 


uM4e 


[A,; cos w,t + B,;sinw,t], 
1 


where w, are known numbers, the real random variables A; and B,; are mutually 
uncorrelated and have zero expectations and variances defined by the equalities 


D[A,] = D[B;] = oy Gj = 1, 2, pee ye 


2 X(t) is considered real. 
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SOLUTION. Since X(t) = >¥_, (G; cos w,t + 5, sin w,t) = 0, by the defini- 
tion of the correlation function 


k k 
K,At,, te) = M { > > [A; cos wt, + B; sin wt, ][A, cos Wile + B, sin onta)}. 
g=l1ll=1 


If we open the parentheses and apply the expectation theorem, we notice 
that all the terms containing factors of the form M[4,A,], M[B8,8,] for j 4 / 
and M[A,8,] for any j and / are zero, and M[A?] = M[B?] = o?. Therefore 
K,(t), te) = Dfa1 07 COS wt, — t4). 

Similarly one can solve Problems 31.3 to 31.6 and 31.10. 


Example 31.2 Let X(t) be a normal stationary random function with 
zero expectation. Prove that if 


fal X@)X(t + 7) 
2) =5[1 + [XOX + al 
then 


Z(t) = * arccos [—k,(7)], 


where k,,(7) is the normalized correlation function of X(t). 


SOLUTION. Using the fact that X(r) is normal, we see that the distribution 
law of second order can be represented as 


1 aap {-# + x3 -— ee 
2no2V 1 — k2(r) 2oz[1 — k2(7)] 


The required expectation can be represented in the form 


x(t) = [ i 5! ep | fxs, x2 | t,t + 7) dx, dx,. 


|x1X9| 


fi, %2.|/t¢+ n= 





Since (1/2)[{1 + (%1x2/|x1x2|)] is identically equal to zero if the signs of 
ordinates x, and x. are different, and equal to one otherwise, we see that 


0 19) oo oo 
z(t) = | | S(%1, Xe | t, t + 7) dxy dxg + [ { f(%1, Xe | t,t + 7) dx, dx, 
—© —~o@ 3) 0 


aa [ f(%1, X2 | t, t + 7) dx, dxo, 
0 0 
which by integration leads to the result mentioned in the Example. (For inte- 


gration it is convenient to introduce new variables r, , setting x, = rcos 9, 
x2 =rsing.) 


PROBLEMS 


31.1 Prove that 
(a) [Kt te)| < Fx(ty Txt) 


1 
(b) |K(t1, te)| < 5) [oz ‘F Oxta)]+ 
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31.2 Prove that |Ryy(ti, te)| < Oxy Fyetg)- 

31.3. Prove that the correlation function does not change if any 
nonrandom function is added to a random function. 

31.4 Find the variance of arandom function X(t) whose ordinates 
vary stepwise by quantities A; at random times. The number of steps 
during a time interval 7 obeys a Poisson distribution with a constant Ar, 
and the magnitudes of the steps A; are mutually independent, with 
equal variances o” and zero expectations, and X(0) is a nonrandom 


variable. 
31.5 Find the correlation function of a random function X(t) 


assuming two values, +1 and —1; the number of changes of sign of the 
function obeys a Poisson distribution with a constant temporal density 


A, and x(t) can be assumed zero. 
31.6 A random function X(t) consists of segments of horizontal 


lines of unit length whose ordinates can assume either sign with equal 
probability, and their absolute values obey the distribution law 


J (|x|) = yest 


e~'*l (gamma-distribution). 


Evaluate K,.(r). 
31.7 The correlation function of the heel angle of of a ship O(t) 


has the form 
K,(7) = ae~“'! cos Br. 


Find the probability that at time fg = t, + 7 the heel angle O(t.) 
will be greater than 15°, if @(f) is a normal random function, 6 = 0, 
@(t,) = S°, +r = 2sec., a = 30 deg.”, « = 0.02 sec.-! and B = 0.75 


31.8 It is possible to use a sonic depth finder on a rolling ship 
whose heel angle ©@(t) satisfies |O(t)| < 9. The time for the first 
measurement is selected so that this condition is satisfied. Find the 
probability that the second measurement can be performed after 79 sec. 
if O(¢) is a normal function, 6 = 0, the variance D[Q(t)] = o? and the 
normalized correlation function k(7) = K,(r)/oz are known. 

31.9 The correlation function of the heel angle ©(t) of a ship 
is K,(7) = ae~*'"![cos Br + («/B) sin B|7|], wherea = 36 deg.?, « = 0.25 
sec.-* and 8 = 1.57 sec.~1. At time ¢ the heel angle is 2°, @(t) > 0. 
Find the probability that at time (t + 2) second the heel angle will have 
) absolute value less than 10° if @(t) is a normal random function and 

(t) = 0. 

31.10 Find the expectation and variance of the random function 
Y(t) = a(t)X(t) + b(t), where a(t) and b(t) are numerical (nonrandom) 
functions and K,,(t,, t2) and X(t) are known. 

31.11] Find the distribution law of first order for the values of 


the random function 


X(t) = A(t) cos [wt + O(1)], 
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if the distribution laws of first order for the random functions A(t) 
and ©(¢t) have the form 


flaly=Se-2™ (@>0, fl Q=+ O<6<2n), 


where w is a constant, and at the same time.A(t) and ©(f) are mutually 
independent. 

31.12 Random points are distributed over the real axis so that 
the probability P, of occurrence of ” points on a prescribed interval 7 
is given by Poisson’s law P, = (Ar)"/n!e-**, where A is a positive 
constant. Find the distribution law of first order for a random function 
X(m) defining the distance between the mth and the (m + 1 + 1)st 
random points. 

31.13 Find the distribution law for the values of a random 
function of two variables U(x, y), if 


U(x, y) = Sx + £0, ¥ + m0) — U(x, y), 
and the correlation function K,(é, 7) defined by 
Ké, n) = M{[L(x, y) a E(x, y)] 
x (x t+ &y+n)—Sx+ &yt+ my}, 
is given in the form 
KE, 9) = ae~%!*!~ 42!" cos B, E cos Bon, 


where €(€, 7) is a normal random function, a = 100,«, = 0.2,a, = 0.1, 
By = 0.5, Bo = 1.0, £ = 1 and No = 2. 


32. LINEAR OPERATIONS WITH RANDOM FUNCTIONS 


Basic Formulas 


An operator is a mapping of functions into functions. The operator Ly 
is called linear and homogeneous if it fulfills the conditions 


L,Ag(t) = ALo@(t), Lolgi(t) + po(t)] = Lopi(t) + Loge(t), 


where A is any constant, and 9(t), p(t) and ¢.(t) are any functions. 
A linear nonhomogeneous operator L is any operator related to a linear 
homogeneous operator Ly by the expression 


Lo(t) = Lop(t) + FC), 


where F(t) is some fixed function. 


3 For a more rigorous definition of the notion of “operator,” see Taylor, A. E.: 
Introduction to Functional Analysis. New York, John Wiley & Sons, Inc., 1958; and 
Heider, L. J., and Simpson, J. E.: Theoretical Analysis. Philadelphia, W. B. Saunders 
Company, 1967. 
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If Y(t) = L, X(t) and the operator Ly is linear and homogeneous, then 
W(t) = Lox(t), Ky(ti, te) = Loe, Lor, K(f, te), 


where L* is the operator L in which all coefficients have been replaced by their 
complex conjugates; the indices ¢, and ft, in the notation of the operator Ly 
show that in the first case the operator acts on variable f,, and in the second, 
on the variable t,. (The possibility of applying the operator to the given random 
function should be verified in each concrete case.) 

If L is a nonhomogeneous operator corresponding to the homogeneous 
operator Ly and to the function F(t), and if Z(t) = LX(¢), then 


Z(t) = Lx(t) = Lox(t) + F(¢), KAti, te) = Lo, Lor, Kx(t, 2); 


1.e., the correlation function does not depend on F(f), the function engendering 
the nonhomogeneity of the operator L. 

A random function is differentiable (once) if its correlation function has a 
second mixed partial derivative for equal values of the variables, which, in the 
case of stationary functions, is equivalent to the existence of a second derivative 
of K(r) for 7 = 0. 

It is considerably more difficult to find the expectation and correlation 
function for the result of the application of a nonlinear operator to a random 
function whose probability properties are known. An exceptional case is 
represented by a normal stochastic process for some types of nonlinear operators. 
For example, if X(t) is a normal random function (we consider X(t) real) 
and Y(t) = X(t), then 


Ht) = M[X%(1)] = D[X()] + 7), 
Ky (ty, t2) = M[X%(4)X7(t2)] — {DLX(4)] + 2°(4) {DIX ()] + ¥7(t2)} 
= 2Ki(t1, te), 


since the expectation of the product of four normal variables X(t), X(t1), 
X(t.) and X(t.) can be obtained by a differentiation of the characteristic func- 
tion of a system of random variables (see Section 23, page 124). 

In the same way one can obtain the expectation and correlation function 
of an essentially nonlinear expression 


Y(t) = sgn X(t), 
if X(t) is normal (see Example 32.2). 


SOLUTION FOR TYPICAL EXAMPLES 


The problems in this section can be solved by using the general formula 
for the correlation function of the result obtained by applying a linear operator 
to a random function; however, in some problems it is more convenient to 
start directly from the definition of the correlation function. The second way 
cannot be avoided if, in addition to linear operators, a given expression also 
contains nonlinear operators. The following are considered examples of appli- 
cations of both methods. 
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Example 32.1 Find the standard deviation of the angle of rotation of a 
direction gyroscope after 10 minutes of rotation as a result of the random 
moment M(t), appearing on the axis of the inner suspension ring, if the law 
of variation of V(t) can be represented by the equation ¥(t) = M(t)/H, where 
the kinetic moment H = 21.10° g. cm.?/sec.”, and 


a 


K,(7) = n?e~*'(cos Br — 3 sin plrl), 
n = 1,36-10* g.-cm.?/sec.?, B= OF see*, a = 0.1 sec.~?. 


SOLUTION. Since by integration we have Y(t) = 1/H fi M(t) dt, (the 
initial conditions by the nature of the problem are zero), i.e., V(t) and M(t) 


are linearly related, for the correlation function K,(t,, t2) we obtain 
] ti te : 
Kilts ta) = 3p | Kale” = tat" de’, 
H* Jo Jo 


and for the variance 


t t t 
D[F(1)] = oy = m | i K,(t" — t’) dt" dt’ = al eT ae 
H* JoJo H? Jo 
Since 
‘ —l_ 4d? : 
e~*i(cos Br — zsin pl!) ede e-*'l(cos Br+ 3 sin alri)}, 


the last integral can be calculated by integration by parts, leading to 


Di?V(7)] = ae {1 — e~(cos Bt + = sin et) 
H*(a* + B*) B 
ts 2n? 
~ Ha? + B?)’ 
Example 32.2 Find the variance of the angle V(z) of rotation ofa direction 
gyroscope after T = 10 minutes of rotation if ¥ is defined by the equation 


d¥ 6b . 
7S _ yee O(2), 


Oy = 45’, 


where © is a normal stationary random function with a correlation function 
K,(r) = ae~*'"(cos Brt+ 3 sin plc), 
where 8 = 0 and 5, H are constants. 


SOLUTION. Here, besides the linear operations of integration and differ- 
entiation, the given expression contains the nonlinear operation signum. Thus, 
using the temporary notation Q(t) = X(t), we set Y(t) = sgn X(t). Using the 
definition of K,(7) as the second central mixed moment of the random variables 
Y, = sgn X(t) and Y, = sgn X(t + 7), we obtain 


(ea) 2) 0 oa) 
Ky) =2 f° [sor xd dade —2 f° [sex de drs, 


where the distribution law f(x,, x2) is normal. 
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Substituting the value of this distribution law and changing from rectangular 
coordinates x,, X2 to polar coordinates, one easily calculates both integrals 
and obtains 


K,(7) == * arcsin k,{7), 
where the normalized correlation function k,,(7) is given by the formula 


k,(7) = kg(7) = e~*'"!(c0s Br — 3 sin Bln). 


The required variance 
2p? t 
DIVO] =F | & - DK) ar 


wee =| (t — 7) arcsin le -«t(cos Br — 3 sin Bir | dr. 


The selene can be solved by another method, too. If we use the formula 
sen X = 1/m, i. e'"* du/u and set it in the initial differential equation, then 
after we integrate with respect to time and estimate the expectation of ‘¥°(t), 
we obtain 


b? t t fo) o du du 
DIVO] =—gorge | fff, Bs ua) SAS ry des, 


where E(u, uz) is the characteristic function for the system of normal variables 
X(t;) and X (tg). 

If we substitute in the last integral the expression for E(u,, u.) and integrate 
it three times, we find for D[¥(t)] the same expression as just obtained. 





Example 32.3. Find the expectation and correlation function of the random 
function 


¥() = aX +) FO, 


where a(t) and b(t) are given (numerical) functions, X(t) is a differentiable 
random function and x(t), K,(t,, t2) are known. 


SOLUTION. The function Y(t) is the result of application of the linear 
operator [a(t) + b(t) d/dt) to the random function X(t). Therefore, the re- 
quired result can be obtained by applying the general formulas. However, the 
solution can be found more easily by direct computation of y(t) and K,(t, ta). 
We have 

sa 


Ht) = Mace) x(0) +b) 29) = anaty) + oe) SP, 











K,(t,, te) = M[ {are v*(1,) — #1) + or(1 [ew - “a0 
x {ales)LX (4) = a) ‘ oe) | (t2) - Si) }] 


. = a*(t,)a(te)Kx(t1, t2) + a*(t1)b(t2) aa K,(t1, te) 


rs) o? 
+ b*(t,)a(te) an, K,(ty, t2) + b*(t)b(te) at, Ole K,(ty, ta). 
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PROBLEMS 


32.1. Find the correlation function of the derivative of a random 
function X(f) if 
K,(7) = ae~*""\(1_ + a|7/). 
32.2 Find the correlation function and variance of the random 


function 
dX(t) 


dt 


if K,(r) = ae~*'*![cos Br + (a/B) sin B|7|]. 

32.3. Let X(t) be a stationary random function with a known 
correlation function. Find the mutual correlation function of X(t) and 
dX (t)/dt. 

32.4 How many derivatives does a random function X(t), with 
a correlation function K,(r) = o?e-*’**, have? 

32.5 How many times can one differentiate a random function 
X(t) if K,(7) = o7e7*" [1 + alr] + (1/3)e27?]? 

32.6 Upto what order do the derivatives of a random function 
X(t) exist if the correlation function has the form 


Y(t) = 


K,(7) = ote-*(I + a|7| — 2a?r? zl)? 


32.7 A random function X(t) has a correlation function 
K,(r) = oe "@"'(1 + |r|). 
Find the mutual correlation function of 
X(t +t) and X(t). 


32.8 The correlation function of a random function X(t) has the 


form 
K,(7) = ofe7*"'(1 + a|7]), 


find the variances for the functions 
Y(t) = X(t+ 7) and Z(t) = X(t + 7). 


32.9 Given the correlation function K,(7) of the stationary 
random function X(¢), 
K,(7) = oe" *™, 


find the correlation function of 


Y(t) = aaa ae 


32.10 Find the probability P that the derivative V of a normal 


stationary function X(t) will have a value greater than b = V5 m./sec. 
if 


dX(t) 
af 


a 


K,{7) = ae~*""(cos Br+ F sin Bln), 


where a = 4sq. m., a = 1 sec.~?, 8 = 2 sec.-}. 
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32.11 Given the expectations, correlation functions and mutual 
correlation function between two random functions X(t) and Y(t), 
find the expectations and the correlation function of the random 
function 

Z(t) = X(t) + YC). 

32.12 Express in terms of the distribution laws of a system of 1 
random functions X,(t) (j= 1,2,...,”) the expectation and the 
correlation function of 


32.13 The correlation function K,(7) of a stationary random 
function X(t) is known. Find the correlation function of Y(t) if 


rosie AO 2 eke. 








32.14 A random function X(t) has the correlation function 
K,(7) = ode *t(1 + alr] + 5e7), 


find the correlation function of 
d? X(t) 
dt? 


32.15 Given the correlation function K,(7) of a random function 
X(t), find the variance of 


va) = [ x@ ae. 


32.16 A stationary random function Y(t) is related to another 
function X(t) by 





Z(t) = X@) + 


dX(t) 
dt 


Find the correlation function of X(t) if X(t) =0 for t=0 


and K,(r) is known. 
32.17 Find the correlation function of X(t) and Y(t) = [, X() 


dé if K,(t,, tg) is known. 
32.18 Find the variance of Y(t) for t = 20 sec. if 


yo = [ x@)ar, 


Kr) = ae-*""(1 + a|7|), @ = 10.cm2)sec.?, « = 0.5 sec.~*. 


Y(t) = 


32.19 Find the correlation function and the expectation of 


dX(t) 
dt 


if x(t) and K,(t,, t.) are known and the constants do, a, and b, are real. 


‘ 





t 
Y(t) = ay X(t) + ay + b, | e~*4 X(t,) dty +c 
0 


32. 
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32.20 Find the mutual correlation function of R,.(t,, ta) if 
Y(t) =aX(t) +6 a, ) 


Fay = oO ra aX, 


where a, b, c and d are real constants. 


32.21 The speed of an airplane is estimated with the aid of a 
gyroscopic integrator that gives an error 


t 
AV() =2 | sin O(t,) dty. 
0 


Here 6(t) is the error in the stabilization of the axis of the integrator, 
the correlation function is 

Ko(r) = 4-10-87 9-98"! rad.2 = ae atl 
and g is the acceleration of gravity. Find the mean-square error in the 


estimate of the velocity after 10 hours of flight (7 is given in seconds). 
32.22. A random function © is real, normal and stationary and 


8 = 0. Find the correlation function 
X(t) = aO(t) + b© + cO%(t), 


where a, 6 and ¢ are real constants. 
32.23. The perturbation moment acting on the rotor of a gyro- 


scope installed on a ship is expressed in terms of the heel angle ©(¢) 
and the angle of trim difference Y(t) by the relation 
M(t) = a@(t) + b¥%X(t) + cO(t)¥(t). 


Find the correlation function M(t) if K,(7) and K,(7) are known, 


Roy(t) = 0, and @(t) and Y(t) are normal. 
32.24 Given that K,(r) = e~%”, find the correlation function 


K,(*) if 
yy = x) + FO. 

32.25 Given 

ee ae~*"(1 26 well 5a), 

find the mutual correlation function between X(t) and d?X(t)/dt?. 

32.26 Given the correlation function K,(r), find K,(t,, t2) if 
Y(t) = a(t)X(t) + b(t) d?X(t)/dt?, where a(t) and b(t) are numerical 
(nonrandom) functions. 

32.27 Let 


Y(t) = [ x@ ae. 


Is there a function X(€) different from zero for which Y(t) isa stationary 
random function? 
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32.28 Is the function Z(t) = X(t) + Y stationary in the broad 
sense if X(t) is a stationary random function and Y is (a) a random 
variable uncorrelated with X(t), (b) Y = X(ty)? 

32.29 Find the variance of the error Y(t) of a nonperturbed 
gyro-inertial system after one hour of its operation if Y(t) is defined by 
the equation 

d*Y(t) 
dt? 
where v = 1.24-10~* sec.~? is the frequency of Shuler and X(t) is the 


accelerometer error, which can be considered a stationary normal 
function of time 





+v*Y(t) = X(t), 


x=0, Kets) = age 


o, = 0.01 m./sec.?, a = 0.1 sec.7?. 


32.30 The angular deviations « and 8 of a free gyroscope used as 
a vertical indicator on a rolling ship are defined approximately by the 
system of equations 


IB _— Ha 
Iné + HB 


—k, sgn re (t)] , 
ke sgn [O(¢)], 


where the moments of inertia J,, /,, the kinetic moment of the rotor 
HT and the coefficients of dry friction k, and k. are constants, and the 
heel angle ©(¢) and the angle of trim difference Y(t) can be assumed to 
be two stationary normal functions of time with known correlation 
functions. 

Find D[e(t)] and D[8(t)] if ¢ is large. 

Hint. Introduce a new function y(t) = (1 [Vaq)o(t) + (1/v’p)B(t), 
g = A/I,, p = A/I, and replace sgn [v(t)] and sgn [O(r)] by integrals 
as shown in Example 32.2. 

32.31 Find the variance of the function Z(t) defined by the 
equation Z(t) + a?[1 + Y(t)]Z(t) = X(t), ZO) = 0, where X(t) and 
Y(t) are independent stationary normal functions with zero expectations 
and whose correlation functions are known. 


33. PROBLEMS ON PASSAGES 


Basic Formulas 


A passage (time) at a given level a for a random function X(t) is a time ¢t 
when some graph of this function crosses the horizontal line XY = a (from 
below). 

The probability that a passage (time) lies in an infinitely small time interval 
dt around point ¢ is p(a|t) dt; the temporal probability density p(a | ¢) is 
expressed in terms of the differential distribution law f(x, v | t) of the ordinate 
of random function X(t) and its derivative V(t) = X(t) computed at time ¢ by: 


p(a|t)= [4 v | t)v dv. 
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The temporal probability density for the intercept of the random function 
(going down) at the level a is 


pi(a| t) = - [fae nay. 


For normal functions, 


(a | 1) = 5 exp {-S 


sig ee 2K Aty, ta) 
= Ele 2e2 KxG 0) 00, Ot. |, n= 


ty =tg =t 





For normal stationary functions, 
1 
p(a| t) = ps(a|t) = p(@) = = exp {-S* 


The average number of passages 7, of a stationary random function per 
unit time is p(a). 

The average number of passages of a stationary function during a time 
interval Tis N, = Tp(a). 

The average duration 7, of a passage of a stationary function is 


[se ax 
p@ | 


7. = 
where f(x) is the probability density for the ordinates of this random function 
For a stationary normal process 


nee) 


Similar formulas hold for nonstationary processes: 
T to) 

| i fx | t) dx dt 
0 a 


T o 
N, = i (i of (a, v | t) dv dt, = +S — 
ie I vf(a, v | t) dv dt 
ie) 0 
The problem of finding the average number of maxima of a random 
function (the passage of the first derivative through zero from above) and some 
other problems can be reduced to problems on passages. For a small average 
number of passages during a time interval 7, the probability Q for non- 
occurrence of any run during this interval can be estimated approximately by 
the formula Q = e~%«; i.e., the number of passages in the given interval can 
be considered as obeying approximately a Poisson law. 
The formulas for the average number of passages and the average time 
between successive passages can be generalized for random functions of several 
variables. 
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SOLUTION FOR TYPICAL EXAMPLES 


Example 33.1 Evaluate the average number of times during 7 = 10 
minutes in which the heel angle ©(t) of a ship vanishes if @ = 0, 


K,(7) = ae~°1!*\(cos 0.77 + * sin 0.1), 


where 7 is expressed in seconds and ©(f¢) is a normal random function. 


SOLUTION. The average number of passages through zero is 


ah Ge bea. 
pO) = 5-2 = 5- V—k(0). 
Since 
k(r) = —(0.77 + 0.17)2-°2i(cos 0.77 — 5 sin 0.7| 1), 
we have 


p(0) = 5 V0.50 = 0.1124 sec.-}, 


and the number of passages during 10 minutes, No = 600-0.1124 = 67.5. 
The required number is 2N, = 135. 


Example 33.2 The heel angle @(¢) and the angle of trim difference Y(t) 
are uncorrelated normal random functions whose correlation functions are 
given by the formulas 


K,(r) = 25e~°°7""!(cos 0.77 + 0.1 sin 0.7|7|) deg.?, 
Kt) = 12.5e-°°2" (cos V2 7 + 10-2V/2 sin V2 |r|) deg.?, 


where 7 is expressed in seconds, and the expectations 6 and @ are equal to zero. 
Find the average time that the mast of the ship is outside the cone whose 
axis is vertical and whose generating angle is 2°, if the deviation of the mast 


from the vertical » can be defined by the approximate formula vy = V ©? + ¥?. 


SOLUTION. This case differs from the preceding one because the function 
v(t) is not normal. Therefore, one should apply the general formula 


[ree 
7 ia uf (a, v) ies 


Ta 


where u(t) = d(t)/dt. 
To find the probability density f(v), it is necessary to integrate the proba- 
bility density of the system of normal random variables ©(¢t), Y(t) over the 


domain v < V6? + ¢? < v + dv, which can be performed easily if we pass 


from rectangular coordinates 6, % to polar coordinates v = V6? + #, 
gy = arctan (5/8). 


33. PROBLEMS ON PASSAGES 195 


After integration we obtain 


v Lfh Dalry. eg 
FO = si, 000 {4 (3 + 2a) Pola (a - a)" 
= e~ 9-3¥? (0.012 
12. IE i at : 

where J,(z) are the Bessel functions of first kind of an imaginary variable. 
To obtain f(y, v), it is necessary to integrate the probability density of the 
system of mutually independent random variables O(t), O(t), Y(t), Y(t) over 
the domain of variance of its arguments where the following conditions hold: 


I 
o 
cal 
uo) 





os 2 VETE <0t a; ve vVOtPcvta. 


This integration can be performed easily if one passes from 6, 6, ¥, % to the 
variables v, v = v, gp, ¢. Using the Jacobian of the transformation, we obtain 


v? ceca Pi 1 [{cos?o _ sin? *) 5 
ee 47 ago, 060) i} in SEP {-5 ( oz ~ oF 


v COS Y — vp Sin —)? v sin D COS —)? 
4: ( P pa P) ba ( P apes 9?) }} ide. 
Pi v5 





By assumptions, oy = oj = 12.5 deg.?/sec.? and, consequently, the double 
integral is simplified and can be a ia 


= 2 
fle, 0) = exp { —55 $2 — 0.038 bio. 012). 
Then 

I ” of 2, v) do = —2? — e-°-127,(0,04), 

0 : 62.5V 20 


If we substitute the result obtained and the probability density f(r) in the 
formula for 7,, we get 


7 = 


Va | e~ 9-0397,7,(0.01v?) dv 
2 
5e~°-127,(0.04) 


Since in the theory of Bessel functions it is proved that 


° Re is 1 
—by2 2 Rea -bx = ‘ 
( e7"" Io(cv?)v dv = 5 [ e~ °*I,(cx) dx aire 
the integral in the numerator can be represented as 
fo) 2 
I e~ 9-03"? T,(0,.01v?)v dv = a - | e~ 0-03¥ T.(0.01v?)v dv. 
2 v2 0 


In the last integral, the value of the argument of the Bessel function for the 
upper limit is very small. Therefore, using the expansion of the Bessel function 


in a series : : Z 
Iz) =1 + (5) + + oy (3) tot ts (3) dete 
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we obtain 





i seal + 10-# fae] dv = 1 (1 25 SO:12): 
i 4” Ee 006 5 ; 


that is, 
25 1 


7a ~ Se-°-18(] + 0.0004 +---) 
Example 33.3. Find the average number of maxima of a normal random 
function X(t) per unit time if 


= 6.0 sec. 


K,(7) = ae~*'(cos Brt+ 5sin Biri), .  X = const. 
SOLUTION. The random function X(t) has a maximum if its derivative 
X(t) has a passage through zero from above; that is, 
oz Var + Bp? 
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é: 1 
Tq > Pi(a) = on 


PROBLEMS 


33.1 Find the average duration of the passage of a normal random 
function X(t) through the level a = 2 cm. if ¥ =—8 cm. and 
K,(7) = 100e-°1""!(1 + 0.1|7|) sq. cm., where 7 is expressed in 


seconds. 

33.2 The average number of passages of a normal stationary 
function through the level a = x in one second is 0.01. Find the 
variance of the rate of change of this function if the variance of the 


function itself is 64 cm.?. 
33.3. The correlation function of the heel angle © of a ship is 


given by the formula 
K,(7) = be-*"\(cos Br+ 3 sin Alcl). 


If the process of rolling is normal, estimate the average number of 
times, in 20 minutes, during which the heel angle is outside the bounds 
+ 25°, if 6 = 0, b = 100 deg.?, a = 0.1 sec.~! and B = 0.7 sec.~?. 

33.4 The output errors of a dynamical system are normal, with 
zero expectation and correlation function 


K(r) = ae~*""(1 + az), 


where a = 5 square angular minutes and « = 1.5 sec.~1. Estimate the 
average number of times in which the system will be turned off if 
this occurs automatically in the case of an error whose absolute value 


exceeds 3’, 
33.5 The correlation function of a normal stochastic process is 


K,(ty, te) = o7tytge~*!2 “411 + alt, — ty\). 


33. 
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Evaluate the time ¢ at which the average number of passages 
through the level @ = X per unit time is less than a prescribed 


number Po (Po > «/27). 

33.6 To remove the damage caused by a random exterior per- 
turbation characterized by a normal random function X(f), it is 
necessary to use power W(t) proportional to X(t): 


W(t) = kX%(t). 
Estimate the average number of times per unit time in which the 


power of the motor will be insufficient to remove the damage, if its 
maximum possible value is wo, x = 0, 


K3(7) = ae~*'"(cos Br+ 3 sin Bll), 


and k, Wo, a, 2 and B are known constants. 

33.7 On an airplane, there is a device (an accelerometer) that 
measures the accelerations normal to the axis of the fuselage and in 
the plane of the wing. The automatic pilot is programed for a hori- 
zontal rectilinear flight with constant velocity. Because of errors in direc- 
tion, the angle Y(t), made by the velocity vector with the fixed vertical 
plane, is random. Estimate the average number of times per unit time in 
which the sensitive element of the accelerometer will go off scale if 
this event occurs when the instantaneous radius of curvature of the 
trajectory of the airplane in the horizontal plane becomes equal to the 
minimal admitted radius of circulation Ry. The velocity of the plane v 
can be assumed constant and 


Kj(te — tf) = ae~*"'(cos Br+ 3 sin Blrl), 


where T = fy — fy. 

33.8 The altitude H(t) of an airplane directed by an automatic 
pilot is a random function whose expectation h is the given altitude of 
flight, and whose correlation function is 


K,(7) = ae~*i(cos Br+ zsin pir). 

Assuming that H(t) is normal, find the minimal altitude fA that 
can be established in the system of devices for pilotless flight so that 
during time 7 the probability of failure caused by collision with the 
surface of the earth is less than 6 = 0.01 per cent, if a = 400 sq. m., 
a = 0.01 sec.-1, 8 = 0.1 sec.~1 and T = 5 hours. 

33.9 A radio control line insures the transmission of a signal 
without distortion if the perturbation X(t) at the input of the receiver 
during transmission does not exceed in absolute value some level a. 
Find the probability Q for transmission without distortion if 


X=0, K,(r) = be~*"(1 + e|7I), 


and the time of transmission is 7. 
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33.10 Find the distribution law for the ordinates of a normal 
random X(t) at its points of maxima if 
x=-0, K,{r) = ae~®™ 


33.11 Given a normal stochastic process X(t), find the distri- 
bution law for the ordinates of its minima if 


K,{t) = ote st(1 + az] + zor’), 
33.12 Estimate the average number of inflexion points of a normal 
random function X(t) in time T if 
K,{(7) = ae~*” 


33.13 Estimate the average number of maxima fi per unit area 
of a normal random function of two variables C(x, y) if its two- 
dimensional correlation function is a function of two variables 


KE, 9) = M{LS*G, y) — SS + & y + 0) — CT, 


and its two-dimensional spectral density 


1 ao wo 
S(w1, 2) = 7a i | e KOs + MK(E, 0) dé dy 


is known. 

33.14 Under the assumptions made in the preceding problem, 
estimate the average number of points # per unit area, in which both 
first partial derivatives f(x, y)/@x and éf(x, y)/dy change their sign 
from “+” to “—.” 


34. SPECTRAL DECOMPOSITION OF STATIONARY RANDOM 
FUNCTIONS 
Basie Formulas 


Any Stationary function X(t) can be written as 


XG e= | * got d@(w), 


where, in the case in which 


| |K,(7)| dr < 00, 
the increments dP(w) satisfy the relations 
. M[d®()] = 0, M[d®*(w) dO(w,)] = S,(w)d(w — w,) dw day. 


Here S,(w) is the spectral density of the random function X(t) and 6(x) denotes 
the 6-function (see Section 11, page 48). 
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The correlation function and spectral density are related by mutually 
inverse Fourier transforms 


@ 


Kel) = [" e*S(w) do, Sew) = 5 [ e*Klo) dr, 


=o 


which are the consequence of spectral decomposition of X(t). For 7 = 0, the 
first of the foregoing formulas leads to 


K,(0) = D[X(1)] = | © Sela) deo. 


The spectral density cannot have negative ordinates; for real functions, 
S,(w) = S,(—w). 


The random functions with finite variance have spectral densities vanishing at 
infinity faster than 1/w. 
The spectral density of the derivative X(t) is related to S,(w) by the 


formula 
S,(w) = w?S,(w). 


The necessary and sufficient condition that a random function be (once) 
differentiable is 


ia w?S,(w) dw < a, 


which holds only if S,(#) approaches zero for increasing w faster than 1/w?. 

If the random functions are stationary and stationarily correlated, then 
between the mutual correlation function R,,(7) and the mutual spectral density 
Sx (w) the following relations hold: 


R,,(7) = i em xy(@) dw , 


LT? 
Su(w) = 5 [|e Ragl) ar. 
From the definitions of R,.,(7) and S,,(w), it follows that 
Ry,(t) = Rix(—71), — Sxy(w) = SH(@). 


The spectral density of the product of two normal (real) stationary random 
functions X(t) and Y(t), 


Z(t) = X(t) ¥(), 


is expressed in terms of S,(w), S,(w) and S,,(w) by the formula 
Sw) = [Sw ~ &)S,(0s) de 


+] Selo — 01)S,(0;) doo, + PS,(w) + F9S,(0). 
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where all coefficients are constant, and the yaw angle ®(t), the angle 
of trim difference Y(t), the heel angle @(t) and the velocities of the 
coordinates of the center of gravity of the ship €,(t), %c(t), o-(¢) are 
normal stationary uncorrelated random functions. 

Express the spectral densities S,(w), S,(w) and S,.,(w), necessary 
for finding the probability characteristics of U(t) on a simulating 
system, in terms of spectral densities S,(w), S,(w), Sew), Sz,(~), 
S;,(w) and S;,(w). 

35.29 For time t » 1/k, find the asymmetry S, and excess Ex 
of a particular solution of the equation 


Y(t) — kY(t) = X(t), 


with zero initial conditions, if X(t) is a normal stationary function, 
x = 0, K,(r) = ae~*""!, 

35.30 Find the mutual correlation function R,,(7) of the stationary 
solutions of the equations: 


d? Y(t) 
dt? 


dY(t) 


oP + AYO = XO, 


+ 2h; 





d*Z(t dZ(t 
ZO 5 24,20 + 1320 = BX, 


where the random function X(t) has the properties of “white noise,” 
(S,.(w) ~ c’), k, > hy > 0, ke > he > 0. 


36. OPTIMAL DYNAMICAL SYSTEMS 


Basic Formulas 


By an optimal dynamical system® we mean a system that for an input 
function X(t) = U(t) + V(t), where U(¢) is the useful signal and V(t) is the 
noise, has an output function Y(t) whose expectation is equal to the expectation 
of some function Z(t), and 


Dje(t)] = D[ Y(t) — Z(t)] = min. 
The function Z(t) is related to the useful signal U(t) by 
t 
Z(t) = NUC) = | mle, 4)UG) des, 
0 


where N is a known operator and n(t, t,) is its Green’s function. 





5 There are other possible definitions of the notion of an optimal dynamical system. 
For example, by optimal system, one can understand a system for which the probability 
that the difference Y(t) — Z(t) in absolute value does not exceed a prescribed quantity is 
maximal. The term “dynamical system” is understood in the technical sense of the word, 
i.e., it means any system whose state (characterized by a function obtained at its output) 
changes because of the influence of external perturbations (random functions at the “input” 


of the system). 


34. SPECTRAL DECOMPOSITION OF STATIONARY FUNCTIONS 201 


Example 34.2 Find the spectral density if 
K(r) = gerne + alr] + er). 
SOLUTION. Using the notation 


J(a, w) = 5 a et gte-altl dz, 


we see that 
oJ ot OFF 


S@)=J—az + ya 


Since 


after differentiation with respect to « and simple transformations, we find that 


807a° 


lage Oar 
Example 34.3 Find the spectral density 
Z(t) = XOXO) 


if X(t) is normal random function and 


K,{7) = ae-*\(c0s Br + sin Alrl), x=). 


SOLUTION. Since 


Z(t) =5 5X0), 


Nile 


S(w) = 5 09S ,2(w) 


ue | © Selo = 01)S,(01)S,(01) do 


_ 2ao{a? + f?) w*(w* + 20a? + 48?) 
= G+ a + BF — LOA? a 
PROBLEMS 


34.1 Given the spectral density, 
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34.2 Given the spectral density 
0, for |w| < wo, 
S(w) = 4 c?, for wo < |w| < 29, 
0, for 2w» < |w|. 


find the correlation function K(7). 
34.3. Find the spectral density S(w) if 


K(x) = ae-*"*(1 + az). 


34.4 Find the spectral density S(w) if 
(1 — |7|) for |r| - , 
| > 


| 
K = 
(7) {. for |r 
34.5 Find the spectral density S(w) if 
K(t) = o7e77!""! cos Br. 
34.6 Find the spectral density S(w) if 
K(r) = ate-*(cos Brt+ 3 sin al) : 
34.7 Find the spectral density S(w) if 
K(7) = ote-*t( + alr] — 2027? + ; <°|7/°). 
34.8 Find the spectral density S(w) if 
K(7) = ae~*'*\(cos Br— sin Bll). 


34.9 According to the form of the spectral density of a random 
function X(t), determine how many derivatives this function has if 


K,(17) = ate-*( + alr] + za). 
34.10 Find the spectral density S(a) if 
K(r) = >, aje~ "71, Rea; > 0. 


j=l 


34.11 Find the values of the quotient «/8 for which the spectral 


density 
w? + at + 


SO) = Et PY aa 


has a maximum at w = 0. 
34.12 Find the variance of the derivative of a random function 


X(t) if e 
S,(w) = Cars 
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34.13 Find the mutual spectral densities S,,(w) and S,z,(w) if 
K,{7) = ae~®”’, 


34.14 The control signal A(z) sent to the control units of an 
automatic system is defined by the formula 


Find S,(w) if 
K,(7) = ae~*""\(1 + alr). 

34.15 A dynamical system (predictor) is used to obtain the value 
of the input random function X(f) at time tf + 79, where 7p is the lead 
time of prediction. Find the mutual spectral density between X(t) and 
Y(t) = X(t + 70), if K,(7) is known. 

36.16 A random function X(t) is fed to the input of a dynamical 
system. Furthermore, X(t) is the sum of a useful signal U(t) and noise 
V(t): 

X(t) = U(t) + V(@). 

The problem of the dynamical system is the calculation of the 

function 
kt 
Y(t) = d* 


ae U(t + 7). 


Find the mutual spectral density S,,(w) if S,(w), S,(w) and S,,(w) 
are known. 
34.17 Find the spectral density S,(w) if 
Z(t) = X(t) Y(t) 


and if X(t) and Y(t) are independent random functions with known 
correlation functions: 


K,({7) = aye™™ (cos Bir + ze sin Bll), 
1 


a 


K,(7) = age (cos Bot + z, sin Bale). 
2 


34.18 Find the spectral density S,(w) if 
Z(t) = X(t) Y(t), 


where X(t) and Y(t) are independent random functions, K,(7) = 
a,e~%!"! Ki (7) = age~%2'"! and x and y are known. 

34.19 The ‘“‘Cardano error” A(t), which occurs by using a 
Cardano suspension in some of the stability devices on ships, is related 
to the heel angle @(¢) and trim difference angle Y(t) by the formula 


A(t) = O@)V(t). 
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Assuming that @(t) and V(t) are independent random functions, 
find the correlation function, the variance and the spectral density 


of the error A(t), if 6 = 4 = 0 and 
K,(r) = ae-% (cos Bene 2 sin Bilrl), 


Kr) = aze~*2"!(cos Por + 7 sin palrl). 
34.20 Find the spectral density S,(w) if 
Y(t) = X(t), 
where X(t) is a stationary normal random function and 
K,(7) = ae~*""(cos Brt+ 3 sin Bll) : 
34.21 Find the spectral density S,(w) if 
Y(t) = X%(t), 
where X(t) is a normal random function, x is known and 
Kz) = ae7*""|; 


34.22 Find the spectral density S,(w) if 
y(t) = x) 4 xO), 





where X(t) is a normal random function, 
S,(w) = ae~?!20?) 


and x is known. 
34.23 The correction A(t) for the roll of a ship to the azimuth 


angle of direction of a navigational radar station is defined by the 
formula 


A(t) = —@(t) + ¥(t)O() cos? g — ; [©2(t) — ¥2(2)] sin 2q. 
Find S,(w) if g can be considered constant, and the yaw angle 


@(t), trim difference angle Y(t) and heel angle @(t) are uncorrelated 
normal random functions with known correlation functions: 


K.(7) =a 1e7%1!1(cos Bit eee Ps . sin Bilrl), 
K,(7) = aze~*"\(cos Bot oe P an Boz ), 


K,(r) = a se-20!1(cos Ba pS z, 2 sin B3|7 ), @¢=6=y,=0. 


34.24 A normal random function X(t) has a correlation function 
(7) = of e~*'*| and expectation X. Find the maximum of the spectral 
density S,(w) if 
Y(t) = X(t). 
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~ 


FIGURE 34 2 


34.25 Two identical disks, whose rotation axes coincide, rotate 
with different (incommensurable) angular velocities Q,; and Q, 
(Figure 34). In these disks there are holes bounded by two radii making 
a central angle y and by the circumferences of radius r — (1/2)A and 
r + (1/2)A. The centers of these holes are selected on the circumference 
of radius y according to a uniform distribution law. 

On one side of the disks is a point source of light L, and on the 
other side a photocell F in front of which is placed a diaphragm D; 
the aperture of the diaphragm has the shape of a sector with angle [° 
bounded by the circumferences of radius r — (1/2)A and r + (1/2)A. 
The intensity of the photocurrent J is proportional to the sum of the 
areas of all the holes within the aperture of the diaphragm. Find the 
spectral density for the intensity of the current S,(w) if there are n holes 
in each disk and if it is equally probable that any hole in the first disk, 
independent of the positions of the other holes, is located opposite a hole 
in the second disk at any angular distance from the optical axis of the 
system, light source and the photoelement.* (Neglect the case when the 
size of the aperture is decreased by the diaphragm.) 


35. COMPUTATION OF PROBABILITY CHARACTERISTICS OF 
RANDOM FUNCTIONS AT THE OUTPUT OF DYNAMICAL 
SYSTEMS 


Basic Formulas 


For any linear differential equation, 


PHO 5g) PGI 4.4 gO = KO, 


the general solution can be represented as 


¥(t) = 3 Cy) + HO), 





* Such a device was proposed by V. S. Gytel’son. 
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where y,(t) is a system of independent particular integrals of the homogeneous 
equation, C; are constants determined by the initial conditions and they are, 
generally speaking, random quantities, Y,(t) is a particular integral of the non- 
homogeneous equation and it satisfies zero initial conditions and is given by the 
equality 


vi) = f olen) XH) de, 


where p(t, t;) is the Green’s function of the system (impulse function) expressed 
in terms of the particular integrals y,(t) by the formula 


yi(t) Ya(ts) yilti) Yalty) 

Vilts) Vrlts) yi(ts) ++ a(t) 
p(t, t1:) = Tide 

Br Pi) ee PE AE) | PE Pe: He PE) 

| y(t) yt) | tyt- (4) yr-P(1,)| 


In the case in which the coefficients of the equation are constants, the 
Green’s function depends only on the difference of the arguments 


P(t, t1) = p(t, — ¢). 
If the system is stable, a,(t) = const., and if X(t) is stationary, then for a 


sufficiently large ¢ (compared with the time of the transient process), the func- 
tion Y(t) can also be considered stationary. In this case, 


a | ae 

er 

fie Pas etn NOs a 
Su) = Gay + aay FF a 


and K,(r) can be found by Fourier inversion of S,(w). 
If X(t) is related to the stationary random function Z(t) by the formula 


d™Z(t) 
at™ 


d™-'Z(t) 


X(t) = bo +b Hani t+ bn Z (2), 





we have 


= |bo(iw)” + b,(iw)™=1 +--+ + bal? 

Se) = Gay F alia Et aye HO) 

the last formula remaining valid even when Z(t) does not have an mth derivative; 

however, the expression for S,(w) decreases faster than |/w when wm increases. 
If the elapsed time ¢ from the start of operation of the system is not large, 

if the function X(t) is nonstationary or if the coefficients of the equation depend 

on time, then to find the probability characteristics of the solution it is necessary 
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to apply the general formulas for linear operators, which (if, for simplicity, the 
constants C, and X(t) are uncorrelated) lead to: 


It) = 3 vsleye, + fle a)K(e) dr, 


K,(t1, t2) = > > V(t) tek + ie ig P*(t1,€) P(tan)Kx(En) dy dé, 


where ||X;,|| is the correlation matrix of the system of random variables C;. 

For equations with constant coefficients, we replace p(t), t2) by p(te — 11) 
in the last formulas. 

If X(t) is a stationary function, then 


vi) = | psniedy + [” yo, 1) dO), 


where y(w, t) is a particular integral of the equation with zero intial conditions 
and where X(t) is replaced by e’. 
In this case, 


K,,(t1, te) = E y*(a, ti) y(e, to) S,.(w) dw. 


A similar formula holds if X(t) is nonstationary, but can be obtained by 
multiplying a stationary function by a known (nonrandom) function of time, 
for example: 


X(t) = b() X(t), 


where X,(t) is stationary. In this case, y(w, t) must be looked upon as a particular 
integral of the equation in which the right-hand side has been replaced by 
b(t)e'‘; i.e., as before, the stationary function has been replaced by e', 

Consider a system of differential equations with constant coefficients 
associated with a stable dynamical system 


a) i > BVO SKs. -F S12. cuens 


where a,, are constants, X,(t) are stationary random functions and time t¢ is 

sufficiently large. Its solutions are stationary random functions, whose spectral 

densities and mutual spectral densities can be expressed in terms of the spectral 

densities and mutual spectral densities of the right-hand sides of the equations 

as follows: 

DQis1 Qm=1 ABA mS xj2em(@) 
|A(w)|? 


De 1 Daa 1 4; HO) A me(@)Sx1m()_ 
ea a 


S,,(@) =; 


> 
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Here A(w) is the determinant formed from the coefficients appearing on 
the left-hand sides of the equations: 


a1, +1w Aye Qin 
ao1 Az + Iw Gon 

A(w) = 3 
Any ane Gna + iw 


where A,,(w) is the cofactor of the element located at the intersection of the ith 
row and the jth column, and S,,,,(w) = S,,(w). 

The distribution law for the solution of a linear equation (system of linear 
equations), whose right-hand side contains normal random functions and 
variables, is also normal. If the equation is linear but the distribution law of the 
random functions on the right-hand side is not normal, the distribution law 
for the solution also will not be normal. The expectation y and the central 
moments p, of this distribution law for any ¢ are determined by the formulas 


t 
We I D(t, ty)X(t;) dt, 
t rt 
wen I, [, pt ty) ptt, to) K;(t1, to) dt, Ate, 


t pt pet 
Pas [ ik [ P(t, ty) p(t, te) p(t, ta)Kx(tr, te, ta) dt, dty dts, 


where X(t) is the random function appearing on the right-hand side of the 
equation and 


Keltss toss) = MUTT LX) — aCe}. 


SOLUTION FOR TYPICAL EXAMPLES 


Example 35.1 The error e(t) in measuring the acceleration of an airplane 
with the aid of an accelerometer is defined by the equation 


a(t) + 2he(t) + ne(t) = gny(t), 


where y(f) is a random function characterizing the random perturbation acting 
on the sensitive element of the accelerometer, and S,(w) = c? & const. 

Find the variance of the velocity of the airplane by integrating the accelero- 
meter readings during time Tif no supplementary errors occur during integration 
and the time for the transient process is much less than T. 
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SOLUTION. By assumption, the error e(t) can be considered a stationary 
random function of time and, thus, 


g?n'*c? g?n*c? 


Sd) = tw) + Dhol? ~ @® — + Pa? 


The error in velocity dv = ip : e(t,) dt, will not be stationary and its variance 


will be defined by the formula D[8v(¢)] = {>} [fj Ke(te — ty) dt, dta. Passing to 


the new variables + = t, — t,, € = te + t; and computing the integral with 
respect to £, we obtain 


D[su(t)] = 2 I "(= )KAx) dr & 2T [ ” Kt) dr 


= 2nTS,(0) = 27g7c?T. 


In a similar way one can solve all the problems in which the required 
random function is a stationary solution of a linear equation with constant 
coefficients or the result of application of a linear operator to a stationary 
solution. 


Example 35.2 For time f¢, find the variance of a particular integral Y,(t) of 
the equation [dY(t)/dt] + a Y(t) = tX(t), with zero initial conditions, if 


a 





Sw) = = 


7 wrt a? 


SOLUTION. In this particular case, Y(t) is not stationary because on the 
right-hand side of the equation there is a nonstationary function of time. 
We have 


t 
Y(t) = | e~ WZ (ty) dty, 
0 


where 
Z(t) = tX(t). 
Since 
K,{7) = | eS (w) dw 4 oze~ etl, 
then 
Kt), t2) = afte oan, 
and 


t it 
DIVA] = Kult) = [ [Kl ences dts da, 


which after integration leads to 
t? _ tQa +a) 2a + « 
2ala+a) 2a a+)? 4a%(a + a)? 


t(a—«a)—1 ~(atayt 4 4a® — (2a + a)(a — a)? en 2at\. 
(@ — 2)? e 4a5(a? — «) 


DLY,(t)] = 2oBt 


+ 
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Example 35.3. Find the spectral density and the mutual spectral density 
of the stationary solutions of the system of equations, 





d? Y(t) dY(t) 
Wt? + 2—- Edie + 4Y(t) + Z(t) = X(t) 
dZ(t) _ ° 
ane + 9Z(t) = X2(t) 
if 
S,,(w) = (ee “7 24 *4dfy > 1)’ Sx,(w) = as 4)’ 


a 
Smal) = Gao + fe 


SOLUTION. If we replace the differential operator by iw on the left-hand 
sides, the determinant of the resulting system of algebraic equations becomes 
—w? + 2iw + 4 I paar 
A(w) = = [(4 — w?) + 2iw](iw + 9). 
0 iw + 9 
The cofactors of the elements of the determinant are: 
Ay =in + 9, Ai. = 0, 
Ag, =—1, Ags = (4 — w?) + 2iw. 
Consequently, applying the general formula we get: 


|A13|?S,., (@) + | Aoi|7Sx.(w) a Ad Aa Sx; x9(@) ae Adi A11S xx; (@) 


Sy(w) = |A(w)|? 
_ ] 
~ (w? + 81)[(w? — 4)? + 4w?] 
o3(w? + 81) 203 _ 2a[w? — 9(w? — >I}, 
m(w? + 1) mw +4)  (w? — 2+ 
A¥, A105 x, (w) + At AgeS x, x9 (@) + AB, Aj 0S 5.x, () oe Ad, Ao2S x, (w) 
Sy(w) = ee Ae oe ee 
pera rer re eo areeeae 
~ [(w? — 4) + Ziw](w? + 81) \(w? — 2)? + iw * nw? + HJ’ 
Sy 203 
S,(w) = li 2() = 


jo + 9/2 mw? + 4)(w? + 81) 


PROBLEMS 


35.1 The input signal of a first-order dynamical system, described 
_by the equation 


wo LevVENSN i: wid: 


35, 
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is a random function X(t) whose spectral density in the frequency band 
Jw| < wo, where w, > a can be considered constant: 


S,(w) ~ c?. 
Find the correlation function of Y(t) for t > 1/«. 
35.2. A dynamical system is described by the equation 
‘i dY(t) dX(t) 
° dt dt 


where X = const. is known and K,(r) = o2e-%""!, a,/ay > 0. 

Find the expectation and variance for the stationary solution of 
this equation. 

35.3 The deviation U(t) of a heel-meter located in the plane of 
the midship frame is defined by the equation 


d?U(t) du(t) 
qa ey 
where F(t) = 1/g{7j,(t) — c@(t)]. The heel angle @(t) and the velocity 


of the lateral shift of the center of gravity of the ship 7,(t), as a result of 
orbital motion, can be considered uncorrelated random functions 








+ Qa, Y(t) = bo + b, X(t), 








+ n?U(t) = n?F(t) (n>h> 0), 


1 


K;,(7) = aye~%!"(cos Bir + B, sin Blrl), 


K,(7) = age~% '!(cos Bort + z. sin palsl), 
2 
and all the constants contained in the formulas are known. Evaluate 


S,(@). 

35.4 An astatic gyroscope with proportional correction is located 
on a ship in the plane of the midship frame. Find the variance for the 
deviation a of its axis from the direction given by the physical pendulum 
if the angle « is determined by the equation 


a(t) + ext) = eU(t) (ce > 0). 


Assume the time elapsed since the start of the gyroscope is sufficiently 
great so that a(t) can be considered stationary; determine the spectral 
density S,(w) by use of the result of Problem 35.3, where 


a, = 1.24 sq. m./sec.?; a; = 0.1 sec.-*: By = 1.20'sée: +: 
dz = 3.8-107? rad.?; a = 0.04 sec.~}; Bo = 0.42 sec.~}; 
h = 0.6 sec.7?; = 6.28 sec.~}; c= 10m; 

e = 0.01 sec.7?. 


35.5 Find the spectral density and correlation function of the 
stationary solution of the equation 


es dE ee ae 
ae 2h + k?Y(t) = X(t) (k >h>O) 


if X(t) has the properties of ‘‘ white noise,” that is, S,(w) = c? = const. 
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35.6 The angular deviation @(¢) of the coil of a galvanometer 
from the equilibrium position in the case of open circuit is defined by the 
equation 

2 
10 +r eo +DON)h=M(), 41ID>P 
where / is the moment of inertia of the coil, r is the friction coefficient, 
D is the rigidity coefficient of the thread on which the coil is suspended 
and M(t) is the perturbing moment caused by the impact of molecules 
from the surrounding medium. 

Find the spectral density and the correlation function of the angle 
@(t) if the spectral density A/(t) can be assumed constant and, according 
to results of statistical mechanics, ofD = kT, where k is Boltzmann’s 
constant and T is the absolute temperature of the medium. 

35.7 Two random stationary functions Y(t) and X(t) are related 


by the equation 








d* Y(t) d*Y(t) dY(t) d° X(t) 
77 6 + Ua Tt + 6Y(t) =5X(t) +7 rh 


Find the spectral density S,(w) for the stationary solution of the 
equation if S,(w) = [4/7(w? + 1)]. 
35.8 Does the equation 
Ya.) —2¥0) + 3¥@) = X(), 
containing on its right-hand side the stationary function X(t), admit 


a Stationary solution? 
35.9 Find the variance of the ordinate of the center of gravity 


of a ship &,(¢) on a wavy sea if 
E(t) + 2hl(t) + w(t) = w2 X(t), 


where the ordinate of the wave front X(t) has the correlation function 
K,(7) = ae~*'"(cos Brt+ 3 sin all); 


h and w, are constants defined by the parameters of the ship, « is a 
parameter characterizing the irregularity of waves, B is the dominant 


frequency of waves and w, > h > 0. 
35.10 The error given by an accelerometer measuring the hori- 


zontal acceleration of an airplane is defined by the equation 
e(t) + 2hé(t) + n?e(t) = gny(t), 


where h = 0.6 sec.~!, n = 6.28 sec.~1, g = 9.81 m./sec.? and the heel 
angle y(t) is a stationary normal random function with a known 


correlation function: 
K,(r) = 3-10-4e-°8'"!(cos 57 + 0.12 sin 5|7]). 


Find the variance of e(t) for the stationary operating mode of the 
accelerometer. 


35. 
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35.11 Prove if the input signal of a linear stable dynamical system 
described by equations with constant coefficients is a random function 
X(t) with properties of “white noise” (S,(w) = c?), then fora sufficient- 
ly long elapsed time after the start of operations, the correlation 
function of the output signal Y(t) is defined by the equality 


K,(1r) = 22c? iy P(t)p(t — 7) dt, 


where p(t) is the Green’s function of the system. 
35.12 Find the variance of the heel angle ©(t) of a ship defined 
by the equation 


O(t) + 2hO(t) + KO) = K2F(t) = (k >h>O), 
if the wave slope angle F(t) has a zero expectation, 


a 


K,(r) = ae~**'(cos Br + 3 sin alr), 


and the rolling process can be considered stationary. 

35.13 A stationary random function Y(t) is related to the 
Stationary function X(t), whose spectral density is known, by the 
equation 


Y(t) + 2hY(t) + k?¥(t) = k2X(0), 


where k > h > 0. 

Find the mutual spectral density S,(w) and the mutual correlation 
function R,,.(7). 

35.14 Given 


Y(t) + 8¥(t) + 7¥(t) = X(0), 
K,(7) = 4e-”", 


find the correlation function Y(t) for times exceeding the time of the 
transient process. 

35.15 The input signal of a dynamical system with Green’s 
function p(t) represents a stationary random function X(t) with zero 
expectation. Find the variance of the deviation of the output signal 
Y(t) from some Stationary function Z(t) if K,(7) and R,,,(7) are known, 
Z = O and the transient process of the system can be considered finished. 

35.16 Using the spectral decomposition of a stationary random 
function X(t), find for time ¢ > 1/a the variance for the integral of the 
equation 


Y(t) + aY(t) = tX(t) 
with zero initial conditions, if 


2 
Ox 2 & 
Tw + a2 


S,(@) a 
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35.17 As a consequence of the random unbalance of the gyro- 
motor placed on a platform with a random vertical acceleration W(t), 
the direction gyroscope precesses with angular velocity 


SG 7 |i +; we), 


Find the expectation and variance of the azimuthal departure 
a(t) at time ¢ if M[L] = 0, D[L] = o?, K,,(7) and Ww are known, P, H 
and g are known constants and L and W(t) are uncorrelated. 


35.18 Find the correlation function of the particular solution 
Y,(t) of the equation 


Y(t) + 2HY¥(t) + kK? Y(t) = e~*X(t) 
with zero initial conditions, if 


oC a 
A Tw + a 
35.19 Two random functions Y(t) and X(t) are related by the 
equation 





(k>h> 0). 


Y(t) — tY(t) = X(t). 


Find K,(t,, tg) if K,(7) = ae~*"! and if for tr = 0, Y(t) = 0. 
35.20 Find the expectation and the correlation function of the 
particular solution of the equation 


Y(t) — a*tY(t) = bX(t) 
with zero initial conditions, if x(t) = 1, 


K,(1) = o2e-?" 
35.21 Find the expectation and the correlation function of the 
solution of the differential equation, 


Y(t) + - Y(t) = X(t), 


if for t = t) € O, Y(t) = yo, where yo is a nonrandom variable and 
x(t) = 1/t; 
K,{ty, te) = tytge tte 4! 


35.22 Write the general expression for the expectation and 
correlation function of the solution Y(t) of a differential equation of 
nth order whose Green’s function is p(t;, tg), if on the right-hand side of 
the equation the random function X(t) appears, x(t) and K,,(t,, t.) are 
known and the initial values of Y(t) and the first (x — 1) derivatives are 
random variables uncorrelated with the ordinates of the random 
function X(t) with known expectations e, and with correlation matrix 
lA sal| Gj = L 2, aaeer n). 

* 35.23 Given the system 


Y(t) + 3¥,@) — ¥.t)= X(t), ~— Y(t) + 2 V(t) = 0, 
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find the variance of Y.(t) for t = 0.5 sec. if for t= 0, Y,(t) and 
Y.(t) are random variables, uncorrelated to X(t); D[Y,(0)] = 1, 
D[ ¥2(0)] = 2, M{L¥i@) — VO] ¥2) — ¥2(0)]} = —1, 


2 
Ss x(w) = mo? + 1 sec. 
35.24 Find the variance for the solutions of the system of 


equations ; 
Y(t) + 3¥,(t) — Y.(t) = oa 
Y,(t) + 2Y¥,(t) = 0 : 
for time ¢ if the initial conditions are zero and 


2 
S,(w) = ate). 


35.25 Find the variance for the solutions of the system of 


equations : 

Yi(t) + 3¥i(t) — Y.(t) = ey 

Y,(t) + 2¥\(t) = 0 : 
for t = 0.5 sec. if S,(w) = [2/7(w? + 1)] and the initial conditions 
are zero. 

35.26 The input signal to an automatic friction clutch serving as a 
differential rectifier is a random function X(t). Find the variance for 
the rectified function Z(t) and the variance of the rectified velocity of its 
variance Y(t) if the operation of the friction clutch is described by the 
system of equations 

bY(t)+ Y(t) = a 

bZ(t) + Z(t) = X(t) J’ 
where a and b are constant scale coefficients, and K,(7r) = o2e7*!"! 
and the transient process is finished. 

35.27 For t = 1, find the distribution law for the solution of the 
equation ; 

Yq) + 3¥(t) + 2¥(t) = X(t) 
if fort = 0, Y(t) = Yo, Y(t) = Yo, and Yo, Yo and X(t) are normal 
and mutually uncorrelated and 

M[Y,] = M[Y] = ¥ = 0, DL Yo) = 15, D[Y,] = 0.2, 

K,(r) = 2e7""!, 

35.28 The deviation U(t) from the vertical position of a plane 
physical pendulum whose plane of oscillation coincides with the 
diametral plane of a ship is defined by the equations 


U(t) + 2aU(t) + Y)U() = X(t), 
X(t) = ar {E,(t) + He(t)O(t) — pelb%t) + F(t) + F(NKO) 
+ plL¥(t) + O()O(t) + 26()0(0)]}, 


Y(t) = nl — Ee) = ee), 
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where all coefficients are constant, and the yaw angle @(t), the angle 
of trim difference Y(t), the heel angle @(r) and the velocities of the 
coordinates of the center of gravity of the ship (1), 7,(t), ¢.(t) are 
normal stationary uncorrelated random functions. 

Express the spectral densities S,(w), S,(w) and S,,(w), necessary 
for finding the probability characteristics of U(t) on a simulating 
system, in terms of spectral densities S,(w), Sy(w), So(w), S:,(w), 
S;,(w) and S;,(w). 

35.29 For time ¢ > 1/k, find the asymmetry S, and excess Ex 
of a particular solution of the equation 


Y(t) — k¥(t) = X%(t), 


with zero initial conditions, if X(t) is a normal stationary function, 
x = 0, K,(r) = ae~*!"!, 

35.30 Find the mutual correlation function R,,(7) of the stationary 
solutions of the equations: 











d?* Y(t adYtt 

24 ds on, ao + Y(t) = K2X(t), 
d?Z(t) dZ(t 

29 + ong ZO 4 saz) = XO, 


where the random function X(t) has the properties of ‘white noise,”’ 
(S,.(w) % c*), ky > hy > 0, kg > he > 0. 


36. OPTIMAL DYNAMICAL SYSTEMS 


Basic Formulas 


By an optimal dynamical system® we mean a system that for an input 
function X(t) = U(t) + V(t), where U(t) is the useful signal and V(t) is the 
noise, has an output function Y(t) whose expectation is equal to the expectation 
of some function Z(t), and 


D[e(t)] = D[ Y(t) — Z(t)] = min. 
The function Z(t) is related to the useful signal U(t) by 


t 
Z(t) = NU() = | nt, 4)U() dr, 
i¢) 
where N is a known operator and x(t, ¢,) is its Green’s function. 


5 There are other possible definitions of the notion of an optimal dynamical system. 
For example, by optimal system, one can understand a system for which the probability 
that the difference Y(t) — Z(¢) in absolute value does not exceed a prescribed quantity is 
maximal. The term ‘‘dynamical] system”’ is understood in the technical sense of the word, 
i.e., it means any system whose state (characterized by a function obtained at its output) 
changes because of the influence of external perturbations (random functions at the ‘‘input”’ 
of the system). 
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To find an optimal system is to determine, according to the probability 
properties of the random functions U(t) and V(t) and the form of the operator 
N, the form of the operator L or its corresponding Green’s function /(t, t;) 
so that the function X(t) can be transformed into the function Y(t): 


Y(t) = LX(t) = (i I(t, 3) X(t) dty. 


The problem of determination of an optimal dynamical system can be 
solved if the following hold: 

(a) the random functions U(t) and V(t) are stationary and stationarily 
connected, and N and L are linear operators independent of time; 

(b) the spectral density S,(w) = S,(w)-+ S,(w) + Sy,(w) + SE(w) is a 
rational function of its argument. It can be expressed as 


Vs 2 | Palw)|? 
Sele) = a OP 


where the polynomials P,,(w) and Q,(w) have roots located only in the upper 
half-plane of the complex variable; i.e., they can be represented as 


Paw) = [1 (om), Qala) = TT (@ 9%, 


where the complex numbers u, and v, have positive imaginary parts, m, and n, 
are the multiplicities of the corresponding roots, >%.3m, = m, DyJ-1m, = 17; 

(c) in the determination of the ordinates of the function Y(t), one can use 
the values of the ordinates of the function X(t) for an infinitely long time previous 
to the current time f. In this case, the transmission function L(iw) of the optimal 
dynamical system related to the Green’s function by 


fom = i © e*L (ja) des, 


id= | fe e-!1](7) dr, 


is defined in the following way (we assume that #@ = 0 = 0): 

If the system operates without delay (that is, Z(t) is the result of application 
of some operator to the present or future values of the ordinates of the function 
U(t)), then 


Ray naan oo) 


x(w) = 2 s wo hy = ae 


=1k=1 





where 


1 dh _ OF(w) 
= G— Bi dol e —29 PA(o) S.) 





? 
= Ay 
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and A, (r = 1,2,...,a@) is the pole of multiplicity Jr (of the expression 
[O*(w)/PA(w)]S,,.(w)) located in the upper half-plane. 

If the optimal dynamical system must operate with delay (that is, the function 
Z(t) is the result of application of some operator to the ordinates of the function 
U(#) at an instant preceding the present time ¢ by 7) seconds), then 








Me) = "Sle ~  Pfe) 
where 
a’ il’, , 
c 
V(@) = ——"" _, 
() = Pe aay 
oc ] a Vv O*(w) 
Chr —_ (I; = k)!} da, -* [(o = Ky) 7 P#(w) s.w)| des 
and «x, (Y= 1,2,...,«') is the pole of multiplicity /, (of the expression 


[O#(w)/P*(w)]S,..(w)), located in the lower half-plane. 
The variance D[e(t)] for the optimal dynamical system is 


D[e(t)] = D[Z(4)] — D[Y@)]. 


If the dynamical system makes use of the ordinates of the random function 
during a finite interval of time (¢ — 7, f) preceding the present time ¢ (‘‘system 
with finite memory”’) and the useful signal is the sum of the polynomial R,(¢) 
of a preassigned degree k (the coefficients of the polynomial being arbitrary 
constants) and a stationary random function U(t), that is, the input function 
X(t) is 

X(t) = R(t) + Ut) + *V(t), 


then under the same assumptions about the form of the spectral density S,,(w), 
the Green’s function /(r) of the optimal dynamical system is defined by the 
formulas 


k ; 2m eo} |O (w)|? 
Wt) = > Dt + D cert + i ome N (in) Su(w)e do 
j=0 r=1 - 2 |Pn(w)| 


+ > 48-90) + > BSt-ME-T) OK<t<T). 
t=1 t=1 
Here a, are the roots of the equation |P,,(i«)|? = 0, N(iw) is the trans- 


mission function of the operator N and the constants on the right side of the 
equality are determined by substituting the expression for /(7) in the equation 


T+ k ; 
{ I(7)K,(t — tr) dr — R,At) = > Ajt? 
-0 j=0 
(O0<t<T), 


satisfied by the Green’s function /(7) of the optimal dynamical system and, 
then, equating the coefficients of equal powers in ¢ as well as those of equal 
exponential functions. To the 2n + k + 1 equations thus obtained, should 
be added the & + 1 equations formed by equating the moments of the function 
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I(r) and the Green’s function n(r) associated with the operator N; i.e., the 
equations 


T+ 
| I(r)7? dt = py; CF =O: 12,6 eck)s 


where 


By = | n(t)7? dr. 

The system of equations thus obtained completely defines all the constants 
contained in the expression for /(r). The transmission function L(iw) can be 
found from /(r) by a Fourier transform 


Lis | e-!1](z) dr, 
and the variance of error e(t) for the optimal system in the present case is 
k 
Dle(t)] = DIZ()] — Rial) + > Aw. 


In a similar way one can solve the problem of finding the Green’s function 
of an optimal dynamical system if the nonrandom part of the useful signal 
contains a linear combination (with constant but unknown parameters) of 
trigonometric or exponential functions of time. The only difference is that in 
the expression for /(r) a similar linear combination will appear, whose co- 
efficients can be determined by substitution in the initial integral equation. 

In some problems one prefers not to form optimal dynamical systems 
because of difficulties connected with their practical realization and, instead, 
one forms systems that are not optimal in the strict meaning of the word but 
that give the minimal variance D[e(t)] among systems whose realization in the 
particular case presents no special difficulties. For example, to find the value of 
the function U(t) at time t + 7 one can take as Y(t) 


and determine a, and a, so that for p(t) = Z(t), 
D[ Y(t) — Z(t)] = min. 


For such a statement of the problem, the determination of the form of 
operator L (the values of the constants appearing in the expression for this 
operator) reduces to the determination of the extremum of a function of several 
variables. 


SOLUTION FOR TYPICAL EXAMPLES 


Example 36.1 A dynamical system is designed to give the best approxi- 
mation of the random function Z(t) = NU(t + 7). Find the mutual spectral 
density S,..(w) if X(t) = U(t) + V(t), and the transmission function N(iw) of 
operator N, the prediction time 7), the spectral densities S,(w), S,(w) and the 
mutual spectral density S,,(#) are known. 
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SOLUTION. Setting U + V (instead of X(r)) in the expression 
RAT) = M{LX*(t) — X*][Z(e + 7) — ZI, 


replacing U(t) and V(t) by their spectral decompositions and taking into 
account that Z(t) = iter n(r)U(t — 7) dr, after simple transformations we 
obtain 


Sx2(w) = [S.(w) ac Syu(w)]N iw)e’*o . 
Similarly one can solve Problems 36.1 and 36.2. 


Example 36.2 The random function X(t) = U(t) + V(t) is fed into the 
input of a dynamical system, where the spectral density of the useful signal 
S.(w) = a«?/(w? + 8), S,,(w) = 0 and the spectral density of noise can be 
considered constant: S,(w) = c?. Find the transmission function L(iw) of the 
optimal dynamical system if the job of the system is to produce the function 
Z(t) = U(t + 7), where (a) 7 > 0, (b) 7 < 0. 


SOLUTION. In this case, 


cPw? + a? + 2B? _ oo |Pilw)|? 


Siw) = —“Sgagege 10,@))?’ P,(w) = w — iy, 
Qo) = 0-18, ya i Vera eR, 


(a) For 7 > 0, the expression [Q#(w)/P#(w)]S,..(w) has one pole in the 
upper half-plane: w = i8; consequently, 


eo, VO Spe A etre oc? 
ROU 8 Seay a = 1p [e 7 sa alice, 
a2 e4 
c2(B + yy + iw) 


(b) For 7 < 0, [Q¥(w)/P#(w)]S...(w) has one pole in the lower half-plane: 
w = —Ily; consequently, 














L(iw) = ——; e*”" 


w+ ip a? ie 
per ee Gua renee \ @=-ly 


Segal fies) | 


Example 36.3 The distance D(t) to an airplane, measured with the aid 
of a radar device with error V(t), is the input to a dynamical system that 
estimates the present value of the velocity by taking into account only its values 
during le (t — T, t). Determine the optimal Green’s function /(7) if 
K,(7) = o2e7*"!; the correct value of the distance can be quite accurately 
approximated by a polynomial of third degree in f, o, = 30 m., « = 0.5 sec.~}, 
B = 2.0 sec.-! and T = 20 sec. 
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SOLUTION. Since to the correlation function K,(7) there corresponds the 
spectral density S,(w) = [ao2/m7(w? + «?)], and the useful part of the random 
signal U(t) = 0, then, in the notations assumed in this example, we have 
k =3,n-—m=1, S,{(w) = S,(w), the numerator of S,(w) contains no w and, 
consequently, it has no roots. 

Green’s function of the optimal system will be 


I(r) => A,8(7) + B,&(7 = T) + Do + Dyr + Dot? + D,7°. 


To determine the constants after substituting /(7) in the equation 


T+ 3 ; 
{ I(2)K.(t — 2) dr = > Aft, 
o- j=0 


we equate the coefficients of equal exponential functions: 


1 2 6 
—0A, + Do — 7 Di + D2 - Ds = 0, 


—oa«B, + Do + ‘a + aT) D, + 50 + 2aT + «’T?) D2 
+456 + 60T + 3a°T? + «3T*)D, = 0. 


Adding to these equations the equalities obtained by equating the moments 
of I(r) and n(r) = 5(7): 


Ay + By + TD) +5 TD, + 5 T°D; + 4T*Ds = 0, 


1 1 1 l 
By + xTDo + 3T*Di + GT°D2 + gT*Ds = —1, 
B,+4rp +irp +1 rep +1 rtp 
1 3 0 4 1 5 2 6 3 
1 1 


I 
o>) 


1 1 
B, + gTDo + gT*Dy + ZT°Dz + = T*Ds = 0, 


we obtain a complete system of linear equations, which determine the required 
constants. Solving this system, we find: 


Do = 5.948-107?, Dz. = 9.618-10-?, A, = 6.138. 
D, = —7.803-107?, D3 = —0.2896-10-?, B, = —2.582. 


PROBLEMS 


36.1 At the output of a dynamical system, 
X(t) = U(t) + VO) 


emerges, where U(t) is a useful signal and V(t) is the noise. Find 
S,(w) if S,(w), S,(w) and S,,(w) are known. 

36.2 At the output of a dynamical system designed to receive a 
function Z(t) = U(t), a function X(t) = U(t) + V(t) emerges, where 
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V(t) denotes the noise added in the reception of the ordinates of 
function U(t). Find the mutual spectral density S,..(w) if S,(w), Sy,(w) 
and S,(w) are known. 

36.3 Find the transmission function L(iw) of an optimal dynami- 
cal system designed to receive the derivative of the random function 
X(t) during 7 seconds before the last observation of the ordinate of 
X(t) if 


a? 


So) = Ga ae 


Find the variance of the error in the estimate of the velocity. 

36.4 Find the transmission function L(iw) of an optimal differ- 
entiable system if the system serves to determine the derivative of a 
random function U(t) at time ¢t — 7 (7 > 0) and, if at the output the 
signalis a random function X(t) that is the sum of a useful signal U(t) 
and noise V(t) not related to U(t). Assume that 


So) = ae SO) = GTR 


36.5 Find the transmission function of an optimal filter designed 
to receive the present value of a useful signal if its input signal consists 
of the sum of the useful signal U(t) and the noise signal V(t); U(t) 
and V(t) are mutually uncorrelated and 

a b? 
ae) ge SONS ge 

36.6 Express the variance of the error of an optimal dynamical 
system in terms of the spectral densities S,(w), S,(w) and S,,(w), 
(U(t) denotes a useful signal and V(r), the noise) if the transmission 
function of the optimal system is L(iw) and N is the operator that, 
applied to the function U(t), minimizes the error in the system. 

36.7 At the output of a dynamical system, designed to receive the 
derivative U(t), X(t) + U(t) + V(t) emerges, where the noise V(t) and 
the signal U(t) are uncorrelated, 

S,(@) = a S,(w) = c? = const 
AO) = (co? — 28)? + 4,2 yw) = c~ = CO . 

Find the optimal transmission function of the system and the 
variance of the error in the estimate of the derivative U(t). 

36.8 Find the optimal transmission function of a dynamical 
system designed to receive the values of the ordinate of U(t + 7) if the 
input signal is represented by a random function U(r), 


a? 


—=—> a> Oy. 7S 0. 
w? + a? ? oa: 


Si(@) om 


36.9 The spectral density of the input signal is S,(w) = 1/(w? + 1)? 
and + >0 is the prediction time. Find the optimal transmission 


function of the dynamical system. 
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36.10 The spectral density of the input signal is 


a?(a? + a”) 


Sx) = “Oey ope 


Find the optimal transmission function of a dynamical system 
designed to produce X(t + 7) and the variance of the error in the 
estimate of X(t + 7) for r > 0. 

36.11 The input to a dynamical system consists of the sum of 
two uncorrelated functions, useful signal U(t) and noise V(t). Deter- 
mine the optimal transmission function for the evaluation of the 
signal at time ¢ + 7 if 7 > 0, 


a? b? 
S,(w) = ata S,(@) = a + BF 
36.12 The input to a delay filter consists of the sum of two un- 


correlated functions, signal U(t) and noise V(t), whose correlation 
functions are known: 


K(7) = o2e72!*1, K,(7) = oe Fl, 


Find the optimal transmission function of the dynamical system 
and the error in filtering if the delay is ty (rT, > 0). 

36.13 The spectral density of the input signal is S,(w) = 
a?/(w* + 4a*) and the prediction time is 7 (+ > 0). Find the optimal 
transmission function of the dynamical system designed for the 
determination of X(t + 7). 

36.14 On a rolling ship it is necessary to determine a time t so 
that rt, seconds later the linear function of the heel angle @(t) and its 
derivative n,@(t) + no@(t) (where n, and ng are known constants) 
will assume a prescribed value c. Find the optimal transmission function 
of the predictor and the variance o? of the error if 8 = 0, 


K,(7) = age-*'"(cos Br+ 3 sin Blrl). 


36.15 The coordinate of a ship moving on a rectilinear course with 


a constant velocity is estimated with an error V(t) characterized by the 
correlation function 


K,(s) = o7e7%"!, 
where o, = 25 m. and a = 0.25 sec.~?. 


Find the maximal accuracy attained in estimating the velocity of 


variation of the coordinate for the observation times T = 20, 40 and 
240 seconds. 


36.16 Under the assumptions of the preceding problem, find the 
maximal accuracy attained in the estimate of the velocity of variation 
of the ship coordinate if 


Kz) = ole“ + alr), 
and all the other conditions are the same. 
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36.17 To estimate the present values of the angular rolling velocity 
Q(t) of a ship, one uses a dynamical system; the input to this system is 
the present value of the heel angle @(t), distorted by an error of 
measurement V(t). Find the variance of the error e(¢) in the estimate 
of the angular velocity if this system can be considered optimal with 
6 = 0, 0 = 0, K,(r) = o2e-%""!, Ry,(r) = 0, Kot) = ofe-*"![cos Br + 
(«/B) sin B\7|], og = 0.1 rad., « = 0.1 sec.~?, B = 0.75 sec.~+, a, = 
2.10-? rad. and a, = 0.5 sec.~1. 

36.18 A dynamical system has been designed to determine the 
values of a random function X(t) at time t + 7, according to the 
values of the ordinates of this function during the interval (¢ — J, t). 
Find the optimal transmission function of the system and the variance 
of the error in the determination of X(t + 79) if the measurements 
of the ordinates of function X(t) are performed practically without 
errors: 


X(t) = cy + Cot + Ut), 


where c, and c, are unknown constants and U(t) is a random function 
whose correlation function is 


Kr) = ofe7*"'(1 + az]), 
o, = 1, « = 0.1 sec.~?, T = 10sec., T = 40sec. 
36.19 A dynamical system obtains the derivative of a random 


function X(t) at time ¢ + 79. Find the optimal transmission function 
of the system if 


X(t) =, + Cot + U(t), = K,(7) = ote “(1 + lz), 


where c, and c, are unknown constants and the system has a “finite 
memory” (that is, uses only the values of X(t) during the interval 
(t — T,T)), o, = 1, « = 0.1 sec.—?, 7) = 10 sec. and T = 40 sec. 

36.20 Find the Green’s function /(r) of an optimal dynamical 
system with “finite memory” 7 designed for the differentiation of the 
function X(t) = R,(t) + U(t), and find the error in the determination 
of X(t), where R, is a polynomial of first degree and 


K,(7) = o2e-#"'(1 + arf). 


36.21 For automatic control of airplanes one can use an inertial 
control system consisting of devices of two types: in the first case, 
during the operation of the system the following signal is determined: 


u(t) = cy + Cot + cg sin Ot + c, cos Nt, 


where ¢1, C2, Cz, C4 are Some (unknown) constants, and Q = 1.25-10-? 
sec. +; in the second case, the signal has the form 


u(t) = cg sin Qt + cy cos Ot. 


» Find the optimal transmission functions of the dynamical systems 
used for the determination of the signal in both cases if the systems have 
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a “finite memory” 7, T = 20 sec. and the useful input signal is 
distorted by an error V(t), 
K,(7) =¢ Ze-*1"(cos Br+ 5 sin Alrl), 6=0, 
2 = 4-10~4. 


p= 3'séc.7? 


a = 0.5sec.~?, 
36.22 The predicting value of the random function X(t + 70) 


is Y(t) = aX(t). Find the value of the constant a that minimizes the 
variance of the error e(t) = aX(t) — X(t + 7,), and the minimal value 


of the variance if x = 0, 
ao2 
S,(w) = m(w? + a?) 
36.23 The predicting value of the random function X(t + 7) is 
the linear combination Z(t) = aX(t) + bX(t). Find the values of 
constants a and b that minimize the variance of the error 
e(t) = aX(t) + bX(t) — X(t + 7), 
and the minimal variance of this error if x = 0, 
(7) = o2e- <i(cos Brt+ 3 sin Bl). 


36.24 The predicting value of the random function U(t + 7) is 


Y(t) = a{U(t) + V(t)], where V(t) is the error in the estimate of the 
present value of the useful signal U(t). Find the value of the constant 


a that minimizes the variance of 
et) = Y(t) — Ut +75) and Df[e(t)} min, 

aoz 0» 
> S,(@) = a(w = PO as + B)’ 


if 
Sy(w) = mw? + a) 


Sy) =0 > 


u 
36.25 A signal must be sent to predict the zero value of the 
derivative @(t) by 7) seconds. Actually the signal is sent at the instant 
in which the following linear combination becomes zero: 
Y(t) = a@(t) + bO(t) + c. 
Find the optimal values of constants a, b and c and the magnitude 


of the variance of @(t + 7) if 6 = 0 
K,(7) =e Ze-er(cos pr+- 3 sin Br ), 


og = 5°, B = 0.7 sec.~+, « = 0.042 sec.~! and 7, = 0.2 sec. 
36.26 Under the assumptions made in the preceding problem 


find the optimal values of the constants a, b and c for which 
D[@(t — 7) — Y(t)] = min. 
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37. THE METHOD OF ENVELOPES 


Basic Formulas 


Any normal stationary function X(t) can be represented for xX = 0 as 
X(t) = A(t) cos ®(f), 


where the random functions A(t) and ®(¢) are mutually uncorrelated. 
The functions X(t) and Y(t) = A(t) sin M(t) have a mutual correlation 
function that can be expressed in terms of S,(w) by the relation 


Rea Gy=d | eC oy cima a2nG): 
0 


where R,,(7) vanishes for 7 = 0. Consequently, for equal times the functions 
X(t) and Y(t) are uncorrelated and, being normal, they also are independent. 

The distribution laws for the ordinates of the functions A(t) and O(t) 
are uniquely defined by the correlation function K,(7) = o2k(7) according to 
the following formulas: 


the one-dimensional distribution densities, 


f@ = 7 
IM=7> O<eK 


the two-dimensional distribution densities, 


aa a? + a2 a,a,.V1 — g? 
Flow as) = Hebewp {— Soe} fe (a): 





q? 1 K 7 ; 
S (1; G2) _ An? Fes + a — «32 (5 + arcsin x): 
where a;, p, and Qe, y, are the values for the amplitude and the phase of the 
envelope at times ¢ and ¢ + 7, q? = 1 — k%(r) — r°(7), « = k(t) = V1 — @? 
cos (v2 — 91 — ¥), y = y(7) = arctan [r(7)/k(7)] and J,(z) is the Bessel function 


of the first kind, of zero order and of an imaginary argument. 
The preceding formulas lead to the conditional distribution laws, 


a az a,a,V1 — gq? ai(1 — q?) 
1 K 7 : 
S(@2 | ~1) = ef + ad — 2 (5 + arcsin «)] 


and the formula for the correlation function, 


K,(1) = 02|2E(1 — 4%) ~ q°K(1 — 4?) - 3]; 
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where K(k?) and E(k?) denote the total elliptic integrals of first and second 
kinds: 
n{2 da 
Ki k? = | eee 
) o VI — k?sin?@ 
ni2 
E(k?) = i) V1 — k* sin? pp dp. 
i) 


The four-dimensional and two-dimensional distribution laws for the amplitude 
of the envelope, its phase and the corresponding velocities have the form: 


a? 


IE OD) Goaae = age 


1 +2 2,2 . 2 
x Xp {- 202(w2 = wi) [a +a (we 2wip + @ )] 2 


2 


a 
qa, >) = 
i #) o2V I V wi — wF 
a” 2 : 22 
: 1 { a? } 
a, SS Se EE ex SS AS a.) eee > 
FG #) o,(27)?/? Vw2 — w2 ‘ 207(wz — af 


f(a, 4) = f(@f@), 
f(g, %) = FP) @); 


a ee 
¢,V in Vaboai  \ 2ot(we — w) 
hes of — w? 
WO = Tan? + oh = oD 
where 
w? = Eas i S,(w)w dw, 
Ox Jo 


wo = 5 , S,(w)w? dw. 


The probability that ¢ is greater than zero is defined by 


P(p > 0) = 5 (1+ “2) 
Similarly, 
1 
P(e < 0) = 5( - 2) 


For a narrow-band spectrum of the random variable X(t) the quantity 
A? = wz — w? is small compared to w7, and some of the foregoing formulas 
can be simplified by expanding the corresponding expressions in powers of the 
small quotient A/w,. In particular, for a narrow-band spectrum the variances 
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D[A(t)] and D[®(z)] become small and, since M[A(t)] = 0, M[®(z)] = «,, by 
differentiating the random function X(t) = A(t) cos M(t) one may consider in 
some cases that A(t) vanishes, and replace ®(t) by w. 

In the case of a narrow-band spectrum, the probability density of the time 7 
during which the random function is above (below) the zero level (“‘the distri- 
bution law of the half-period’’) has the following approximate expression 

aA2r 
LO ® Fe or + Te 


whose accuracy increases with the decrease of the quotient A/w,. 


SOLUTION FOR TYPICAL EXAMPLES 


Example 37.1 Find the average number of passages per unit time for the 
random function 
O(t) = Ot) — wyt, 


where ®(f) is the phase of the normal random function Y (t) if 
K,(7) = o7e- "(1 + alz]), 


2 ao 
oo I S,(w)w dw, “ = 0.1 sec. -?. 
SOLUTION. We determine the spectra] density 
1 ¢* _ 
Sle) = 5g |, Kel dr = toh 


Consequently, site 
aes ede. By 
1 Jo Pap = SS. 
7 


Applying the general formula for the number of 


obtain Passages per unit time, we 
= 6, 6 — 
4 I, i oxo |6 dé. 


: — wyt, © has a unig, 
Since O(t) = Ot) — #2 Uiform gic. | 
(0, 27), and the distribution pe es 6) can be oeettion law in the interval 
py 4 in the distribution law /(p, ¢); tha, is, MEd easily if we replace 


@ by 6+ wy, 
[oe 4n[6? + (w2 ei 
; 20s tot) ]3/2? 
where * 
wh = FZ) See)a2 
xdvod au 5 
a 
Ka formula for p, 
setting £(9, ) 1 _ We get 
1 V/ we _ Wy => ~ 4 
=a 4 
P 4a 72 <9 
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PROBLEMS 


37.1 The correlation function is defined by the formula 
Ks) =:02e-*""!, 


Considering X(t) normal (* = 0), find the correlation function for 


the amplitude of the envelope of this function. 
37.2 What is the probability that the phase of the envelope of a 


norma] random function X(t) will decrease if 
K,(7) = o2e-*"(1 + a|z|), =O, 
« = 0.01; 0.10; 0.50 sec.-1? 


37.3. For a stationary normal random function X(t), find the 
probability that the phase will increase (decrease) if 


Kia = o3e~*!"\(cos Br + G sin Alr\). 


37.4 Find the probability P that the velocity of variation of the 
phase of the envelope will be greater than 


oO, = 5 I S,(w)w dw 


K,(7) = ate~*'"(cos Br + 3 sin Bll), x=0. 
37.5  Foranormal random function X(t), find the distribution law 
for the velocity of variation of the phase if 
K,(7) = o2e-*"11 + «|7), x=0. 

37.6 Find the distribution law for the phase of a normal random 

function X(t) — xX, for which 
Kr) =o2e7*"".” 

37.7 Find the distribution law for the velocity of phase variation 


of a normal random function X(t) with spectral density 


Cc? 


DAO) = Grea gt dee 


37.8 Find the distribution law for the envelope and the velocity 
of variation of the envelope of a normal random function X(t) if 


2a3o2 
mw? + a)?” 
37.9 Under the assumptions made in the preceding problem, 
find the conditional distribution law of the envelope at time t + 7 if at 
time f 


S,(w) = x=, 


A(t) = ox, es DSec2. a = 0.1 sec.~!. 
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37.10 Find an approximate expression for the distribution law 
of the time during which a random function is below the zero level if 


K,{7) = aieW0°tt\(cos 0.77 + 55 sin 0.771), x=0. 


37.11 Assuming that the formulas for the envelope of a random 
function with a narrow-band spectrum are applicable, find the distri- 
bution law for the intervals between successive moments during which 
the deck of a ship passes through equilibrium if the heel angle @(Z) is a 
normal random function, whose correlation function 


K,(7) = age-°I(cos 0.77 + sin 0.1\7\), 6=0, 


and there is no pitching. 
37.12 Find the average number of passages beyond the level 


20, per unit time for a random function A(t) if A(z) is the envelope of 
the normal random function X(t) and 


K,(7) = o2e7*"'(1 + a7), x=0. 


37.13 Find the average number of passages beyond the level 2c, 
for the amplitude of the envelope of a normal stochastic process X(t) 


if 
K,{7) = oten*"(1 + alr] + er), x =0-. 
37.14 Find the conditional distribution law for the phase of a 
normal function X(t) at time ¢ + 7 if at time ¢, the phase is zero and 
a 


K,(7) = ate-*\(c0s Br+ B sin All), x=-0. 


Neglecting the variance of the amplitude of the envelope, determine 
the variance of X(z) at time (¢ + 7/w,), where 


WO, = ral S,(@)w dw, a = 0,0] sec.~+, B = 0.70 sec.~?. 


37.15 Find the mutual correlation function for two normal 
stationary random functions X(t) and Y(t) if 


X(t) = A(t) cos D(t), Y(t) = A(t) sin O(2), 


K,(7) = ete-°01FI(cos 0.77 + = sin 0.7|x1), KX =0. 
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Basic Formulas 


Let S be a finite sample space consisting of outcomes Q,, Qo,..., On- 
A sequence of trials of the underlying experiment is called a finite Markov 
chain if p,,(k), the conditional probability at the Ath trial of Q,; under the 
assumption that Q; occurred at the (k — 1)st trial, is independent of the outcomes 
at the (A — 2)nd, (A — 3)rd,... trials. The events Q,, Qo,..., O, are called 
states of the Markov chain and the kth trial can be considered as the change of 
state at time ¢,. 

In each column of matrix A = ||\p;,,(k)||, there is at least one element 
different from zero, and the transition probabilities p,,(k) (i,j = !,2,...,m) 
for any k satisfy the relation 


2 PK) = @=1,2,..5m). 


A Markov chain is called irreducible if any state can be reached from any 
other state and periodic if the return to any state can be made through a number 
of steps, which are a multiple of some « > 1. 

A Markov chain is called homogeneous if the transition probabilities 
pik) are independent of k; that is, p,,(k) = pi; (i, 7 = 1,2,..., m). 

The column p(n) = {p,(n); po(m);...3 pn(n)}, which is formed of the un- 
conditional probabilities that at the nth trial the system will pass respectively 
to states QO,, Qo,..., Om, iS defined by the formula 


p(n) = (FZ. -- Fy’), 
and for a homogeneous chain by 
p(n) = (F')"p(O), 


where the accent means transposed matrix; that is, if A = |p,,;', then 
PF = Ipal: | 

For any n, but relatively small m, to calculate YW” we can use the Lagrange- 
Sylvester formula, which in the case of simple eigenvalues A), Ag,..., Am (roots 


of the equation |A® — Y| = 0, where & is the unit matrix) has the form 


n— Y (P= ME) (FP = Me 1 EWP = Mes 16)- > (FP = An) 


- k=l (A, _ A): ‘ (Ax e Ax -WOx a Neti)" ; Ox ~ Am) 


Nee 
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In the general case, for finding #” it is convenient to reduce F to normal 
form 7 = HJH™~, where J is a diagonal or a quasidiagonal matrix, depending 
only on the eigenvalues of matrix #. For simple eigenvalues, J = ||6,,,A,||, 
where 5, = 0 for i# k and 4,, = 1. The elements of matrices H and H7} 
are the solutions of algebraic equations of the form FH = HJ, HP = JH™, 
HH~1 = @. Then #* = HJ"H~?, where for simple eigenvalues J” = |/6,,Az]]. 

The elements p{}? of matrix F” are also determined by the Perron formula 


(n) loo | as eee Es v") ? 
Pu . @, — 1)! lds? jae — Z| = 


where r is the number of distinct eigenvalues, », is their multiplicity 
(Si<1¥s = m) and A,,(A) is the cofactor of the element A8,, — p,, in the determi- 
nant |A@ — Y|. The matrix P® = || p{P?|| of the limiting transition probabilities 
and the column p(co) = (¥”)p(0) of the limiting unconditional probabilities 
can be obtained from the corresponding expression by passage to the limit for 
n-> oo. The limits exist only if |A,| < 1 for s = 2,3,...,r (for the transition 
probability matrices |A,] < 1 always obtains and one eigenvalue 4, equals 
unity). For this, 


d’i- : 
Salad — AAs - Aj 


Po = v,——_,___________>_, 
oe ae - | 


A=1 


where »v; is the multiplicity of the eigenvalue A; = 1. 
For v; = 1, all m rows of matrix Y® are equal and the elements of the 
column p(co) coincide with the corresponding elements of any row; that is, 


pf{o) =piP=p j= 1,2,...,m). 


In this case, the probabilities p$* can also be determined from the solution of 
the algebraic system 


2,Pupl™ = pe — (f= 1,2,...4 m0), where 3 pi = 1. 


If the finite Markov chain is irreducible and nonperiodic, then to find the 
probabilities p$°? one can use the last equations. If the number of states m = 00, 
the Markov chain is irreducible and nonperiodic and the system of linear 
equations >i, 4p; = u; GV = 1,2,...) has a nontrivial solution for which 
Die1 |u| <0, and probabilities p§S( pS > 0, 7 = 1, 2,...) are the solutions 
of the system 321 pusp = pS (j= 1, 2,...), where SP, p§ = 1. 

If one can separate a group of states ar the system so that a transition 
from any state of this group to any of the remaining states is impossible, the 
group can be considered an independent Markov chain. A group may consist 
of one state Q, so that p,, = 1; Q, is called an absorbing state. 

In the general case, from the states Q;, Qz,..., Q, one can select mutually 
disjoint groups C,, Cz,..., C, called essential states; the rest form a group T 
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of inessential states. For a proper numbering of states, the matrix FP is reduced 
to the form 


R, O --- O 0 
O Re QO --- O 
P= , 
0 O Ry 0 
U W 


where R,, Ro,..., R, are the matrices of transition probabilities of the groups 
C,, Co,..., Ch, W is a square matrix associated with the inessential states of 
group 7, and U is a nonzero (if there are inessential states) not necessarily 
square matrix. 

If all the eigenvalues of matrices R,, Ro,..., Ry, except those equal to 
unity, are less than unity in absolute value, then 


R? 0 0 
0 Re 0 
gr = 
0 0 Re 0 
Us, 0 | 


where U,, is some rectangular matrix. 

Let h = 1 in the matrix Y; 1.e., there is one group C of absorbing states. 
If the Markov chain formed from the states of this group is nonperiodic, the 
probabilities p,; of transition from an inessential state Q, to the group C of 
essential states is determined from the equation 


Psi = > PivPxv a > Pir 
T Cc 


where in the first term the summation is extended over inessential states and 
in the second over the essential states. 

Let x; (j = 1,2,..., 4) be the number of eigenvalues (considering their 
multiplicity) of the matrix R, that are not exactly equal to unity, but equal in 
modulus to unity. The minimal common multiplicity of these eigenvalues is 
the period « of the Markov chain. If the chain is irreducible, all states of the 
periodic chain can be divided into groups Go, G;,..., G,_, so that a transition 
from a state contained in G, always leads in one step to a state in G, 4, (G,, = Go). 
In the Markov chain with matrix Y*, each group G, can be considered an 
independent chain. The following limits for r = 0, 1,...,« — 1 exist: 


lim per? = 


lho 


Pre if Q; is from G,, and Q, is from G,,,, 
0 otherwise; 


the probabilities p,, ,, are determined as in the case x = 0. 
In the general case, there also exists a matrix (¥‘)” and matrices 
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P, = P(P*)* (r = 0, 1,...,* — 1). The matrix Y = |!f,,|| of mean limiting 
transition probabilities is defined by the formula 


DHE PLA PHIPY®. 


The column f of mean limiting unconditional probabilities is given by p = 
F' p(0). If h = 1 in the matrix Y, then the mean limiting unconditional prob- 
abilities 6; (j = 1, 2,..., m) are uniquely defined by the equalities: A’p = p, 
Deshi aul 


SOLUTION FOR TYPICAL EXAMPLES 


Example 38.1 Some numbers are selected at random from a table of 
random numbers containing integers 1 to m inclusive. The system is in state Q,; 
if the largest of the selected numbers is j (j = 1, 2,..., m). Find the proba- 
bilities pf (i, k = 1, 2,..., m) that after selecting nm random numbers from this 
table, the largest number will be k if before it was i. 


SOLUTION. Any integer 1 to m appears equally probable in the table of 
random numbers and, thus, any transition from state Q, (the largest selected 
number is 1) to any state Q, is equally probable. Then p,, = 1/m(j = 1, 2,..., 
m). The transition from Q, to Q, is impossible and, consequently, p2, = 0. 
The system can remain in state Q, in two cases: if the selected number is | or 2 
and, consequently, poo = 2/m, po; = 1/m (j = 3, 4,..., m). In the general case, 
we find 


Pi = > Pi = 0 for i> jf; Diz =+ for i<j 
Cee Sas bee eres 77) e 


The matrix of transition probabilities can be written as 





Le eee tot 
m mm m mm 
a i 
m mM m em 
nA m mom 

0 0 0 m—1 
m wn 

0 0 0 


The characteristic equation 


pe - 9} =T] (1-4) =o 


k=1 
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has roots A, = k/m(k = 1, 2,..., m). To find the probabilities p{, representing 
the elements of the matrix #”, let us apply Perron’s formula. The cofactors 
A,,(A) of the elements of the determinant |A& — Y| are the following: 


— G 
fori>k An(A)=0: Ay(A) = pe A. 
eee 
re AOS] (a - =) ll (. - =) 
, = m yv=l m T=k+1 m 
Ae — P| 


Substituting these expressions in Perron’s formula, we obtain 


0 for i>k, 

Ge (=) for i=k, 
Pie = <\m 

(Se eee 


In a similar way one can solve Problems 38.3 to 38.10. 


Example 38.2 A vending machine that sells tokens in a subway station 
can be operated with nickels and dimes. If a nickel is inserted, the machine 
releases one token if the container, which can hold m nickels, is not full; otherwise 
the machine releases no token. If a dime is inserted, the machine releases one 
token and a nickel change if there is at least one nickel in the container; if not, 
the machine turns off. One knows that a nickel and a dime are inserted with 
probabilities p and g = p — 1. Find the probabilities p§P (i, k = 0, 1,..., m) 
that after n demands for tokens, the machine will contain & nickels if initially 
it held i nickels. 


SOLUTION. Let the state Q; mean that the container has / nickels (j = 0, 
1,...,m). For 1 <j < m -— 1, a transition from Q, to Q;., is possible with 
probability p and to Q;_, with probability g. When the states Qy or Q,,, repre- 
senting absorbing states, are reached, the machine turns off. Therefore, 


Poo = 1, Pam = 1, Pj,¢+1 = Ps P33-1 = 4 G= 1,2,...,m— 1). 


The matrix of transition probabilities has the form 


100 0 00 0 
q 0 p 0 0 0 i O° 
p= 0qg0p :-- 00 0 -_lu w vi. 
a a ee ee ee ae Ge 
0 q 0 p 
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where W is a square matrix of order m — 1, and U and V are two columns of 
order m — 1; 


0 p 0 0 q 0 
q 0 p 0 0 
W = 0 q 0 0 0 U = 0 y= 0 
moot tet Wed 
0 0 0 q 0 0 Pp 
where the matrix W is associated with the inessential states Q,, Qo,..., Qm—1- 


The required probabilities are the elements of the matrix 


l 0 0 
F- =U, WwW" V,i|, 
0 860 1 


and, consequently, 


PS = 1, p@ = 1, pP =0 (ry = 1,2,...,m), 


Pe 0 (CGH 0 lhc, = 1) 


To find the elements of matrix W", form the characteristic equation 
An-1 = |A€@ — W| =0. For determinants of this type there obtains the 
following recursion relation: 


A, = AA,_1 — pgA,_2 (k=: 2,330 25. = 1), 
with A, = 1, A, = A. Then, 
Ama te et = Cr 25 pga * 4s apg yen S222 = 0, 


The last term of the equation is (— 1)*-/?(pqg)™-?/? for odd m and 
(— 1)" ??(m/2)(pq)\"~ »? for even m. 


Making the substitution 4 = Vpq [u + (1/z)], we can write the equation 
An-1 = 0 in the form 
Pq (m-1)/2 f= em 
bei (BP Se 
From this it follows that u, = exp {i(ka/m)} (kK = 1, 2,...,m — 1). Therefore 
the eigenvalues will be A,, = 2V pq cos (km/m) (k = 1,2,...,m — 1). 
The matrix W can be reduced to the form W = H/JH™}, where J = 
|\2Vpq cos (km/m) 8,,||, and H = |\A,,|| is to be determined. 
The matrix equation WH = HJ is equivalent to the following equations: 
Pho,x = hy Ags Gin 2, i _ Nn—1,1%Mes ghy—1,% oe Physi = hy Ax 
VG = 2,3,---,;m—2; k =1,2,...,m—1). 
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Up to a factor, the solutions of this system are the elements 
712 
hig (2) sin (ae pe te ee ab 


Thus, H = |\(q/p)’'? sin (kja/m)|. 
The inverse matrix H~? can be written in the form 


k/2 . ; 
= YaeP) = IC. (2) sin 
q m 


From HH~?} = @, we find C, = 2/m(k = 1,2,..., m — 1). Using the equality 
W” = HJ"H~', we obtain 


pi? = > Ayn, P 


ae ihe it. if. kr 
— Sp Deg heros >» siete sin yr Aes 
m j=1 m m m 


(i,k =1,2,...,.m—). 


To determine the elements pS? (j = 1,2,..., m — 1) of the column U,, 
we shall use Perron’s formula. The characteristic polynomial of the matrix 7 
will be |A® — P| = (A — 1)? [227 (A — A,). For the cofactors of Ay,A) of 
the elements of the determinant |A® — Y|, we get the following expressions: 





m—-j-1 aaa 
AoA) = GA - 1) TI (2 — 2V pq cos id ) 6 aw ee ree es Fe 
k=l m— J 
Ao,m-1(A) = g™ "(A — 1). 


ps = Ao,(1) <= AEA o(Ax) ; 
Typ? (i = ea Ge = Pa Oe a) 


where the asterisk means that the factor with k = v must be eliminated from 
the product. 

The probabilities pS? (j = 1,2,...,m— 1) can be calculated similarly. 
To evaluate them, we can also use the equalities 


Then, 


ew ee "5. pit G= 1 2g Se 


Problems 38.1! to 38.14 may be solved similarly. 


Example 38.3. A substance is irradiated by a stream of radioactive ele- 
ments during equal time intervals At. The probability that during irradiation 
the substance will absorb r radioactive particles is determined by the formula 
B, = a'/r! e~*. Each radioactive particle contained in the substance may decay 
during two successive irradiations with probability g. Find the limiting proba- 
bilities for the number of particles in the substance. 


SOLUTION. Let state Q; mean that after an irradiation the substance will 
contain i (i = 0, 1,...) radioactive particles. During the interval At the transi- 
tion from Q; to Q, will occur if i — v particles (vp = 0, 1,..., 7) decay and 
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k — v (k > v) are absorbed by the substance. The transition probabilities are 


i(k) qke-¥ 
Pik = 2, Cip*q'- ‘ea (i, k = 0, Ie2a2}s 
where p = | — q, and summation is extended up to i if i < k, and up to k 
ifk <i. 
The substance can contain any number of particles; 1.e., all the states 
of the system are attainable. Therefore the Markov chain is irreducible. Since 


probabilities p;, are different from zero, the chain is nonperiodic. 
Let us consider the system of equations 


Mev =% (= 0,1,...). 
We set 


G(z) a > U;z’, 
7=0 


and multiply both sides of the system by z’, sum over j from 0 to oo, and then 
apply the formula n — 1 times. Hence, 


G(z) = exp {a(z — I)}G[1 + (@ — lp] 
exp {az —1)(1 +p t+ p? +---+ p™*)}G[] + ( — 1p’). 


From this, we find that 


a \ 
G(z) = exp {2 (z — phew) = exp {Seq >, te) 


Comparing the two expressions for G(z), we obtain 


() 

a a q oa 

u, = exp { Shaq) 4 GH 0; ere 

Since >}.5 |u,{| = G(1) and the arbitrary constant G(1) can be taken different 
from zero and infinity, the algebraic system has a nontrivial solution and the 
Series > |u,| is convergent. Consequently, p{*? can be determined from the 


system D729 pizpS” = pS (j = 0, 1,...). The system for p{* is similar to the 
preceding system solved for u,; and, therefore, 


(7) 
pS? = exp { -Z}a(1) fe (j =0,1,...). 


Since >. 9 pS’ = 1, G(1) = | and, thus, the required probabilities are 


n= exp { ~5 (eee ys fas 


One can solve Problems 38.16 to 38.22 in a similar way. 


I 
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Example 38.4 The number X of defective items in each independent 
sample of size N selected from an infinitely large lot obeys a binomial distribu- 
tion law; that is, P(X = k) = p, = Chp*g"-* (k =0,1,...,N),q=1-—p. 
If a sample contains r defective items, then according to the acceptance criteria, 
one considers the lot as changing its preceding state Q, to Q,,,-. The lot is 
rejected ify + r — 1 > mand accepted if vy + r — | = 0. Find the probability 
that the lot will be accepted if its initial state is OQ, (j = 1,2,..., m — 1). 


SOLUTION. There are m+ 1 states Q; (i = 0,1,...,m — 1) possible. 
If the state Qy is reached, the lot is accepted; if Q,, is reached, it is rejected. 
Since these two are absorbing states, poo = 1, Pam = 1. If i #4 O andi ¥m, 
Pit+j-1 = Pj (j= 0, 1, sey M — 1), Dim =l1- DFa0 Pi (i = ree ++) mM — 1). 
The matrix of transition probabilities is 


1 0 0 0 .-- 0 0 0 
Po Pi P2 Ps sts Dm-2 Pm-1 Pi,m 
Po Pi P2 Pm-3 Pm-2 P2,m 
P= 0 O po pi Pm-4 Pm-3 Pa,m 
0 0 0 0 Pi P2 Pm-2,m 
0 0 0 0 Po Pi Pm-i,m 
lo 0 0 0 0 0 1 


The required probabilities p,; (j = 1,2,..., m — 1) are the probabilities 
of transition from inessential states Q,, Q2,..., Qm-1 to the essential state Q) 
and can be determined from the algebraic system 


m-1 
Px = 2 PivPay + Pj G= L 2th 1), 
which can be written in the form 


m—-1 
(pi — 1)pei + 2 PrPxk = —Po> 


PoPar-1 + (Pr ~ Wier +,"3 PeerePae=0 (= 2,3,..,m— 1). 
The determinant A,,_, of this system can be found by the recursion formula 
Amar = (Pi WAmar-a = 3, (=P Anes 
GH 12cm ST); 


where Ay = |. The required probabilities are determined by the equations 


sp Nia pe : 
Bal G=1,2.3.. 98 S41). 


m-1 


Problems 38.23 to 38.25 can be solved in a similar way. 
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Example 38.5 A truck transports goods among 2m points located on a 
circular route. These goods are carried only from one point to the next with 
probability p, or to the preceding point with probability g = 1 — p. Find the 
probabilities pS? (j, k = 1, 2,..., 2m) that after n transports the truck will pass 
from the jth point to the kth point. Evaluate these probabilities for n— oo 
and compute the mean limiting probabilities of transition. 


SOLUTION. Let state Q; (j = 1,2,...,2m) mean that the truck is at the 
kth point. The transition probabilities are 


P3,74+1 =P V= 1,2,...,2m — 1), 
Pjj3-1 =] (j = 2,3,..., 2m — 1), 
Pani =P, Pijam = 4. 


The matrix of transition probabilities is 


0 p 0 0 0 q 
q 0 p 0 0 
0 g O p 
P= 
0000 0 p 0 
000 0 q 0 p 
P00 0 0 q 90 
Let us introduce the matrix H = jhy,!, = |le%~P%-»] of order 2m, in which 


e = e™/™, By direct multiplication, we find that PH = H\(pe*-? + ge~*-)8,,,|| 
and, consequently, the eigenvalues of F will be A, = pe*~! + ge“ *-» 
(eo 15 25 acy 2m): 

The eigenvalues with maximal absolute value are A, = 1 and A,,4, = —1; 
they have multiplicity one and, thus, the chain is periodic with period « = 2. 
The inverse matrix 


Hees AS. >| = as jer e=PerD| 3 


From the equality 7” = HJ"H~*, where J” = |A,.6,,||, we find 


1 2 ; 
(A) _ > (v-1 -W-D]n,-DU-# 
Pik = [pea ige r= tes Sa, 
PAs) Sore 


which can be written as 
l mn. 
(n) _ n - yo -(v- nv —1)3 -k) 
aoe poet a a ae as 2, [pe Pie Gee eee en 


(j,k = 1,2,..., 2m). 


All terms in the sum except the first are smaller than unity in modulus so that 
forn—>o, 


I 
PR > 55 U1 + (D4, 
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This implies that 


1 
; —, for j+ k — even, 
lim p3? =<m J % 
ae 0, for j+k—odd, 
l : 
lim pgrt? = m7 for j +k — odd, 
RO@w 


0, for j+k — even. 


The last equalities can be written without using the expression for pS? as an 
irreducible chain, and the transition in one step from the group C, of states 
with odd numbers always leads to the group C, of states with even numbers 
and conversely. 
The mean limiting transition probabilities are 
| 


ree : < 
Pye = 5 lim (on? + pi) = yO GK = 1,2... 2m). 


Using this solution, one can solve Problems 38.26 and 38.27. 


Example 38.6 In discussing the fundamental statements of kinetic theory 
of matter, Ehrenfest proposed the following model: m molecules distributed 
in two Containers are randomly removed one by one from one container to the 
other. Find the mean limiting unconditional probabilities for the number of 
molecules in the first container. 


SOLUTION. Let the state Q, mean that there are i molecules in the first 
container (@ = 0,1,...,m). Then p,;-1 =i/m, Piis. = 1—i/m G@=0,], 
...,m). The matrix of transition probabilities can be written as follows: 





0 1 O 0 0 0 
Lo) ts 6 0 0 

m m 

5 g 

p20 3 10> ASS 0 0 
1 
00 O 0 0 = 
m 
lo Oo 0 0 1 0! 


From any state Q,, a return to Q; is possible only in a number of steps 
that is a multiple of two. Therefore, in the present case, the Markov chain is 
periodic with period « = 2. The chain is irreducible because each state can be 
reached from any other state. 

The column # of mean limiting unconditional probabilities can be deter- 


mined from the condition Fp = p; that is, 





rts ,_*=1); k+l, ae ae a 
Pi = Po; He P-1 = Pr+i = Pes Pr = me 


(k =1,2,....m—1). 
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From this it follows that p, = foC%. Using the equality >?_, 6, = 1, we find 
that 1/po5 = S75 Ch = 2™; consequently, the required probabilities are 
Pe=aaCh (kK =0,1,...,m). 


Similarly one can solve Problems 38.28 and 38.29. 


PROBLEMS 


38.1 Show that for a homogeneous Markov chain the transition 
probabilities p{? are correlated by the equality 


m™m 
po = 2 PP? 7 = Mp2 cau, mM), 


38.2 Given the column of initial probabilities p(0) = {e, 8, y} 
and the matrices of transition probabilities for times f, fo, f3, 


&, Ag Ag Qo Ag ay Og , Ao 

DY iS = a= 

Py = 1% 1 oll, Py, =H, Ag 3 \\> P, = |}%2 Fg II, 
Oo Aq Oy Og @, A O, A ag 


determine the column of unconditional probabilities p(3). 

38.3. According to the rules of a competition, a contestant quits 
a match if he loses two points in one game or if there are two ties. 
A contestant without ties can win at each game with probability a, 
can tie with probability 8 and can lose with probability 1 — « — 8. 
In case of one tie, the probability of winning at each game is y. Find the 
probability of losing various numbers of points in n games for the 
contestant whose outcomes in the previous games are known. 

38.4 If the current in an electric circuit increases, the blocking 
system of a certain device fails with probability « and the entire device 
ceases to operate with probability 8. If the blocking system fails, then at 
the next increase of current the device ceases to operate with proba- 
bility y. Find the probabilities that no failure will occur in the circuit, 
that only the blocking system will fail and that the device will cease to 
operate after n increases in current, if the initial state of the device is 
known. 

38.5 There are several teams in a certain competition. During 
each round only three members of a team can compete with another 
team. According to the rules of the competition no ties can occur and 
the one who loses once is eliminated from this competition. Let a, B and 
y be the probabilities that, in the next round in turn, among one, two, and 
three members remaining respectively, from a team, none loses; let 8; 
and y, be the probabilities that in the next round, in turn, among two 
and three remaining team members, respectively, one loses and let 
y2 be the probability that two among three members of this team lose. 
Determine the probabilities p (i, k = 0,1, 2,3) that after n rounds, 
A members of this team compete if before these rounds i members 
of the same team competed. 


38. 
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38.6 An automatic system can operate if from N identical units, 
m — 1 fail; each unit can fail only during an operation cycle. The 
probabilities p,, of transition of the system during one cycle from state 
QO; to state Q, are known, where the index of a state represents the 
number of units that failed so that for k <i, py, = 0 (i,k =0,1, 
.,), Pmm = 1. Prove that the transition probabilities p§P for n cycles, 
during which the defective units are not replaced with probabilities 
Px = Pex (kK = 0, 1,..., m), are determined by the formulas: 


PQ = pr (k= 02 Io 25590) 
fori > k, phi =0 (i,k =0,1,...,m) and fork >i 
PD, if Pv) 


(n) ’ 
far -> i (Py — Pi)(Pv — Pisa)? (Pv — Pv-1)(Py — Pvss) 
-* (Dy — Pr-1)(Py — Px) 
where 
Pi,jit+i Pi,ji+2 Piji+3 Piyke-1 Pix 
Pi+1 — A Pi+1,i+2 Pit+rji+a Pit+ijye-1 = Pt+1,k 
0 ee er 
Da)'= Pit+e2 Pi+2,14+3 Pi+2a,n-1 Pi+2,% 
| 0 0 0 Pr-2,k-1 Pr-2,k 
0 0 0 eS Digs pens 
38.7 Prove that if under the assumptions made in the preceding 
problem p,,. = p (k = 0, 1,..., m — 1), then 
Pan = 1, ie (kK =0,1,...,m-— 1); 
fori > k, p?P =0G,k =0,1,...,m), and fork > i 


pip = AEE Du} 


my — @— Wt fart fae Dni() 

p= ia [ea |}, + a 
where D,,;(A) is determined by the formula of the preceding problem 
for p, = p(k = 0,1,...,m — 1). 

38.8 From an urn containing N white and black balls, m balls are 
drawn simultaneously. The black balls are used to replace the white balls 
that are drawn. Initially the urn contains m white balls and after sev- 
eral drawings it contains i white balls. Determine the probabilities p\? 
(i,k = 0,1,...,m) that after m additional drawings there will be k 
white balls in the urn. Evaluate these probabilities for N = 6, m = 3. 

38.9 For a given series of shots, each marksman from one group 
scores any number of points ranging from N + 1 to N + m with equal 
probabilities. Determine the probability that among the next n 
marksmen of this group at least one will score N + k points, if the 
maximal number of points scored by the previous marksmen is N + i 
Get = 1.22355 M1). 
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38.10 Along a straight line AB in a horizontal plane, there are 
placed identical, vertical cyclinders of radius r whose centers are a 
distance / apart. Perpendicular to this line spheres of radius R are 
thrown, and the path of a moving sphere crosses AB with equal proba- 
bility at any point of the interval L on which there stand m cylinders. 
The distance between the centers of the cylinders is / > 2(r + R); each 
time a sphere hits a cylinder the number of cylinders decreases by one. 
Determine the probabilities p (i,k =0,1,...,m) that after n 
throws k cylinders will remain if before this there were i cylinders. 

38.11 Ina domain D, partitioned into m equal parts, points are 
placed successively so that their positions are equally probable through- 
out the domain. Determine the probabilities p§ (i,k = 1,2,..., m) 
that after placing a new series of n points, the number of parts of D 
containing at least one point will increase from i to k. 

38.12 At times 4, to, tg,... a Ship can change its direction by 
selecting one out of m possible courses, Q,, Qo,..., On. The proba- 
bility p,; that at time ¢, the ship changes from Q; to Q;i8 pi; = Gm-iaja.s 
and Oni, =o, #0 (Kk = 1,2,...,m), >, a, = 1. Determine the 
probability p\ that for t, < t < t,41, the direction of the ship will be 
Q,, if the initial direction was Q; (j, kK = 1, 2,..., m). Find this proba- 
bility for n = oo. 

38.13 Consider the following model of the diffusion process with 
central force. A particle can lie only on the segment AB at points with 
coordinates x, = x, + kA (k = 0,1,...,m), where x, = Xp. It shifts 
stepwise from x; to the next point toward A with probability j/m, and 
to the next point toward B with probability 1 — j/m. Determine the 
probabilities p (i, k = 0, 1,..., m) that after n steps the particle will 
be at point x,, if initially it was at x;. 

38.14 The assumptions here are the same as in Example 38.2, but 
the machine does not turn off. When there are no nickels in the container 
and a dime is inserted, or there are m nickels and a nickel is inserted, the 
machine returns the last coin inserted without releasing a token. Find the 
probabilities p{? (i, k = 0, 1,..., m) that after n demands for tokens, 
there will be & nickels in the container if initially there were i nickels. 

38.15 Two marksmen A and B fire shots in turn so that after 
each hit A fires, and after each failure B fires. The right for the first 
shot is determined on the same basis, by reference to the outcome of a 
preliminary shot fired by a randomly chosen marksman. Determine the 
probability of failure at the nth trial independent of the previous hits 
if the probabilities of failure at each trial for these two marksmen are 
« and f, respectively. 

38.16 Given the matrix F = | p,,| of transition probabilities, 
that is irreducible, nonperiodic and twice-stochastic, i.e., the sum of 
elements of each column and of each row is unity, find the limiting 
probabilities p§* (j = 1, 2,..., m). 

38.17 There are m white and m black balls, that are mixed 
thoroughly and then equally distributed in two urns. From each urn 
one ball is randomly drawn and placed in the other. Find the proba- 
bilities p,, (i, k = 0, 1,...,m) that after an infinite number of such 
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interchanges, the first urn will contain k white balls if initially it 


contained i white balls. 
38.18 A segment AB is divided into m equal intervals. A particle 


can lie only on the midpoint of some interval and shifts stepwise by 
an amount equal to the length of one interval toward point B with 
probability p and toward point A with probability gq = 1 — p. At the 
endpoints of AB, reflecting screens are placed so that upon reaching A 
or B, the particle is reflected toward its initial position. Find the limiting 
unconditional probabilities pf? (k = 1, 2,..., m) that the particle is in 
each of the m intervals. 

38.19 Given the following transition probabilities for a Markov 
chain with an infinite number of states, 


i 1 
Pi = PA Pii+1 = FETS | 


determine the limiting probabilities p§ (j = 1, 2,...). 

38.20 The transition probabilities for a Markov chain with an 
infinite number of states is defined by pi, = 4, Pii41 =D =1—-—4 
(i = 1,2,...). Find the limiting probabilities pS (Vj = 1, 2,...). 

38.21 A Markov chain with an infinite number of states has the 
following transition probabilities: 


1 I I i-1 . 
Pu =p P2=5? Pa=z? Piit1=—- = 2,3,...). 


Find the limiting probabilities p§@? (i, k = 1, 2,...). 

38.22 A particle makes a random walk on the positive portion of 
the x-axis. The particle can shift by one step A to the right with proba- 
bility «, to the left with probability 8 or it can remain fixed; it can 
reach only points with coordinates x;(j = 1, 2,...). From the point with 
coordinate x, = A, the particle can move to the right with probability « 
or remain fixed with probability 1 — «. Find the limiting transition 
probabilities p{™ (kK = 1, 2,...). 

38.23 The matrix of transition probabilities is given in the form 


R 0 
P= > 
U W 
where R is the matrix associated with the irreducible nonperiodic 
group C of essential states Q,, Qo,..., Q;, and the square matrix W 
is associated with the inessential states Q,.1, Q;12,..., Om. Determine 
the limiting probabilities p,; (7G = s + 1, 5 + 2,..., m) that the system 


will pass into a state belonging to group C. 
38.24 The matrix of transition probabilities is given in the form 








R 0 0 
P= |0 R, O |, 
U U, W 


where R is the matrix corresponding to the nonperiodic group C of 
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essential states Q,, Qo,..., Os, and the square matrix W corresponds 
to the inessential states Q,.1, Q,42,..., Om. Find the probabilities 
Pes G=rt+i,r4+2,..., m) that the system will pass into a state 


belonging to the group C if all the elements of W are equal to @ and the 
sum of elements of any row of matrix U is B. 

38.25 Two players A and B continue a game until the complete 
financial ruin of one. Their probabilities of winning at each play are, 
Tespectively, p and q (p + q = 1). At each play the win of one player 
(loss for the other) is one dollar, and the total capital of the players is m 
dollars. Determine the probabilities of financial ruin for each if A has j 
dollars (j = 1, 2,..., m — 1) before the game begins. 

38.26 Given the transition probabilities p,;,; = 1G = 1,2,..., 
m— 1), Pmi = 1, determine the transition probabilities pS? and the 


mean limiting transition probabilities 6, (Vj, k = 1, 2,..., m). 
38.27 The matrix of transition probabilities is 
a By 4 
0010 
oS ‘ 
000 1 
0100 


where « # |. Determine the transition probabilities p%? and the mean 
limiting transition probabilities J; (Vj, k = 1, 2, 3, 4). 
38.28 Given the elements of the matrix of transition probabilities, 


P3,7+1 = P (j= 1,2,..., 2m — 1), 
Pij-1 =Q=1-—p Cf = 2535 0.352); 


without evaluating the eigenvalues of the matrix 9, find the limiting 
transition probabilities and the mean limiting unconditional proba- 


bilities. 
38.29 A particle is displaced on a segment AB by random impacts, 
and can beat the points with coordinates x; = x, +A (j=0, 1,..., m). 


Reflecting screens are placed at the endpoints A and B. Each impact 
can shift the particle to the right with probability p and to the left with 
probability q = 1 — p. If the particle is next to a screen, any impact 
shifts it to the screen in question. Find the mean limiting unconditional 
probabilities that the particle is at each division point of the segment 
AB. 


39. THE MARKOV PROCESSES WITH A DISCRETE NUMBER 
OF STATES 


Basic Formulas 


The behavior of a system with possible states Qo, Q;, Q2,..., O,, can be 
described by a random function X(t) assuming the value k, if at time ¢ the 
system is in state Q,.. If the passage from one state to another is possible at any 
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time ¢, and the probabilities P,,(t, 7) of transition from state Q; at time ¢ to 
state Q, at time t (7 > t) are independent of the behavior of the system before 
the time ¢, then X(t) is a Markov stochastic process with a discrete number of 
states. (The number of states can be finite or infinite.) 

The transition probabilities P;,(t, 7) satisfy the relation 


Pit, t) = y P(t, S)P iS, 7); t<s<r. 
7=0 
The process is homogeneous if 


P(t, 7) = Pi(t — £). 


In this case, for the Markov process 
Pi{t — t) = > Pils — t)Py(7 — 5), f<s<r. 
J=0 


A Markov process is called regular if: 


(a) for each state Q,, there exists a limit 
| 
c(t) = lim AG (1 — P(t, t + Arty]; 
ato At 


(b) for each pair of states Q; and Q, there exists a temporal transition 
probability density p,,(¢), continuous in ¢, defined by 


1. Put, t + At) 
: genet | AN ee, 
Pielt) C(t) ato At 
where the limit exists uniformly with respect to ¢, and for fixed k uniformly 
with respect to 7. 
For regular Markov processes the probabilities P,,(t, 7) are determined 
by two systems of differential equations: 


OP; 
Poult T) = —¢,(t)Pi(t, 7) + > Pt, 7) ¢(7)pj(7) (the first system), 
J#k 
Pull D - (2) Plt, 7) — c(t) > Pt, 7) pis(t) (the second system) 


j#. 
G, j,k = 0,1,2,...,m), 
with initial conditions 
Pi, (t, t) = Six» 


Ss b,. fort =k, 
*" \0, for i¢k. 


For a homogeneous Markov process, c,(f) and p,,(t) are independent of 
time, P;,(¢, tT) = Pi,(7 — t) and the systems of differential equations become 


where 


add =—c¢,Pu(t) + > cspP(t) (the first system), 
T#K 
Bult = —¢Pi(t) +c >, pizPy(t) (the second system) 


d#k 


(i, j,k = 0,1, 2,...,m) 
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with initial conditions 
Pi {0) = Six. 


The probabilities P,,(¢) that the system is in state Q, at time ¢ is given by the 
system of equations 


Pl) (Pt) + > MOPAOPKD Uk = 0,1,2,...4m), 


with corresponding initial conditions for P,(t). If the initial state Q,; is given, 
the initial conditions are 
P,,(t) = Six for t= 0. 


For homogeneous Markov processes, the last system becomes 


dP,{t 
a =~ Pt) + > cpeP(t) Gk = 0,1,2,...,m), 


J#K 
and the initial conditions are 
P,{t) => SK for i= QO. 


If for a homogeneous Markov process there exists a time interval ¢ > 0 
such that P;,(t) > 0 for all i and k, then the process is called transitive and for 
it the limit 

jim Pit) = lim P,(t) = Px 


exists independent of the index of the initial state. The limiting probabilities p,, 
in this case are determined from the system of algebraic equations 


CrP = 2, CiPinPs (i, = 0, 4,2, ery). 


The equations for probabilities P;,(¢, 7) and P,(t) can be obtained either by 
applying the foregoing general formulas or finding the variations of probabilities 
for different states of the system during a small time interval Ar and passing to 
the limit as At —> 0. 

An example of a Markov process is the simple flow of events with the 
following properties: 

stationarity, that is, for any At > O and integer k > 0, the probability 
that k events will occur during the interval (¢, t + At) is the same for all t > 0; 

absence of after effect, that is, the probability of occurrence of k events 
during the interval (¢, ¢ + At) is independent of the number of occurrences 
before the time ¢; 

ordinarity, that is, 

. R(At) 
ee At 


where R,(Af) is the probability that at least two events occur during interval Ar. 


0, 


SOLUTION FOR TYPICAL EXAMPLES 


Example 39.1 A system can be in one of the states Qo, Q, Q2,..., and 
it passes, during time At, into a state whose index is higher by one with proba- 
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bility AAt + o(At). Find the probabilities P,,() of transition from state Q; to 
state Q, (k > i) during time ¢. 


SOLUTION. The process is Markovian by assumption. Moreover, it is 
regular, since 


c 


os 


= lim = [AArt + o(At)] = A = const., 
ato At 


_ 1, AAt + o(At) _ 
Piisill) = C; iim aa Teas 


— 
v 


and otherwise p;, = 0. 


Consequently, the equations for homogeneous Markov processes are 
applicable; 


aPi(t) 





dt = —AP;,(t), 
PD — AP) + Pei) (k>i+D), 


with initial conditions P;,(0) = 6,,. Multiplying both sides of the obtained 
equations by u* and summing over k from / to ©, we get 


OG(t, u) _ 
Se (u 


where G(t, u) = ei Pi(tu®. 
The solution of the last equation has the form 


In G@, uv) = Aw — It + InG(O, uv). 


— 1G, y), 


Since by definition, 
G0, uw) = 2 Pi(O)u* = vw’, 
kai 


we have 
MO up we CALE 
= Au-Dt = yig-At Qr)” — p-at k 
G(t, u) = u’e u'e 2S e D&D" 
Comparing the last expression with the definition of G(t, u), we obtain 
= (ni i 
Pi(t) = (k=)! e~ mM 


The initial system of differential hen for P;,(t) can also be obtained 
in another way: the probability P,,(t + At) is the sum of the probability 
P,,(t)[{1 — AAt — o(Ar)] that the passage from state Q, to state Q, (k >i) 
occurred during time 7 and the probability P;._,(¢)[AAt + o(Ar)] that this 
passage occurs in the interval (¢, + Ar); that is, 


Pi (t + At) = Py(t)[1 — AAt — o(At)] + P;.-1(t)[AAt + o(Ar)). 


Transposing P;,(t) to the left side of the equality, dividing both sides by At and 
passing to the limit as At —> 0, we obtain the required equation. In this manner 
the equation for k = i can be deduced. 

Problem 39.6 may also be solved in a similar way. 
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Example 39.2 A queuing system consists of a large (practically infinite) 
number of identical devices, each device servicing only one call at a time and 
spending on it a random time that obeys an exponential distribution law with 
probability density we~“*. The incoming calls for service form a simple queue 
with parameter A. Evaluate (a) the probability P,(t) that at time ¢ exactly n 
devices will be busy (” < m) if initially all devices were free; (b) the limiting 
probabilities p, = lim,.. P,(t); (c) the expected number of devices busy at 
time ¢. 


SOLUTION. Since the queue of calls is simple and the servicing time obeys 
an exponential distribution, during the time interval (¢, ¢ + At) the system 
will change its state more than once with a probability whose order of magni- 
tude is higher than At. 

Therefore, considering only the first-order terms during time interval At, 
we obtain: 


Prnailt, t + At) = AAt(1 — mAt) + o(At) = AAt + o(At), 
Pron-i(t, t + At) = (1 — AAt)npAt + o(At) = npAt + ofAt), 
(1 — AArt)(l — npAt) + o(At) 

= 1 — (A+ np)At + o(At). 


P, A(t, t + At) 


The system is regular because 


1 — Py(t, t + At) 


> jim Ar = A+ mp = const., 
Ltd oe (t, ¢ + At) r 
cl OS is em ND oe ey 
i ame Sarre. At A+ np 
Pan-1 = us lim Pan-i(t, t + At) t + At) wast Ol 
; Cn At+0 At A+ np 


(a) We substitute the calculated values for cp, Pnn+i and Pn.»-1 In the 
system of differential equations for P,(t): 





BPD) + my) PA) + P.O) + + DpPaa(d, 
forn > 1 and 
Pot) _ _ Pyle) + PAO). 


{f one assumes that at time ¢ = 0 all devices are free, the initia] conditions are 
P,(0) => Onns 


The resulting system can be solved with the aid of the generating function 


: G(t,u) = > P,(t)u". 
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Multiplying both sides of differential equations by u* and summing, after simple 
transformations we find 


aG(t, u)) | 


aG (t, 2669 4 — of - AG(t, w) + pA 


The initial condition is G(O, u) = 1. 
The resulting linear nonhomogeneous partial differential equation is 
replaced by an equivalent homogeneous one,* 


oV OV oa 
a HL - Mai - Ml WG 56 = 9, 


with initial condition V = G — 1 fort = 0. 
To solve the last equation it is necessary first to solve the system of ordinary 


differential equations 
dt du dG 


1° pl-w) AM—wG 


whose independent integrals are 


l 
ad —u=c, 


ne ee 
B 


Using the initial conditions t = 0, u = ug, G = Go, we obtain the Cauchy 
integrals of the system 
u=1—-(-we™, 


Go = Gexp {° d—-wd — em. 


The right-hand sides are the principal solutions of the homogeneous partial 
differential equation. Using these solutions, we form the solution of Cauchy’s 
problem for the homogeneous partial differential equation 


V = Gexp (a — ul - "ae, => 


The solution of the Cauchy problem for the initial equation is the function G 
for which V = 0; hence, 


G = exp {-: gd -—-wd — em). 


The probabilities P,(¢) are related to the generating function G(t, uw) by the 
equality 

1 aG(t, u) 
ni Ou 


P,(t) 





u=0 


1 Weinberger, H. F.: First Course in Partial Differential Equations. Waltham, Mass., 
Blaisdell Publishing Company, 1965; and Petrovskii, I. G.: Partial Differential Equations. 
Philadelphia, W. B. Saunders Company, 1967. 


252 MARKOV PROCESSES 


which leads to 


rio ~Affa ea ao{ toe} 


that is, a Poisson law with parameter 
r 

a=-(l1—e-“%). 
iu 


(b) The limiting probabilities p, are obtained from the initial ones by 
passage to the limit: 


‘ 1 /A\" kK 
pa = lim P,(t) = = (2) exp {—“}; 
that is, p, obey a Poisson distribution law with parameter a = A/u. (The same 
result can be obtained if we solve the system of algebraic equations obtained 
from the differential system for P,(t) after replacing P,(t) by p, and [dP,(t)/dt]} 


by zero.) 
(c) The expected number of busy devices is 


M(t) = > nP,(t). 


For M(t), write the differential equation: 


dM(t) xX 7 oP rkt) 
dt & dt 





= 2 m—A + np)Prlt) + APa-i(t) + (2 + De Paai(O} = A— eM (tf). 


n= 


Since initially all devices are free, 
A 
M(t)=-(1-e-“). 
(t) ae ) 


Problems 39.17 to 39.19 may be solved in a similar way. 


Example 39.3. A queuing system consists of m devices, each of which, at 
any given time, can service only one call. It services for a random time, obeying 
an exponential distribution law with parameter ». The incoming calls form a 
simple queue with parameter A. A call is serviced immediately after it is received 
if there is at least one free device at that time; otherwise, the call is rejected and 
does not return to the system. Determine the limiting probability for a rejected 
call. 


SOLUTION. Let Q; denote a state of the system in which i devices are 
busy, then, P;,(t) > 0 for a finite time interval. Consequently, we can apply 
Markov’s theorem, stating that there exist limiting probabilities such that 


Pr = lim P,{t), 
toa 
and determined by the formula 


CrPn = Cn~1Pn-1,nPn-1 + Cn+1Pnat+i,nPati: 
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As in the preceding example, we have 





r 
Crh = A+ np, Paynt+1 = A+ np 
nye 
= <n<m- 
Poor = 7h O<n<m-1), 
Cy, = Mp, Pmym+1 = 0, 


and the other probabilities p,, = 0. Substituting these values for p,, in the equa- 
tions for p,, we get 


(A + 1p )Pn = Pa-1 + (M+ IePnsr =O n<m—1; p-1=9), 
MEDm = Dm-1- 
If we set Zz, = Ap,z_-1 — npup,, the system becomes 
Z1=0, 2% — Zn+1 = 0 (0<n<m), z, =0, 


hence, it follows that z, = 0 for all m and this means that 


mee ae =5(7)' 
Pa = 7 Pat 6 ee pL Po- 


The system is certainly in one of states Q, (n = 0,1, 2,..., m), therefore, 
» Pr = 1; 
n=0 


from this, the probability po that all devices are free is 


1 
Po = m 


Soy 


n=0 


The probability that the service is refused is 
mt (e) 
— mi \p 
oi) 
n=0 n} iad 


Following this solution, Problems 39.8, 39.10, 39.11 and 39.14 may be 
solved. 


(Erlang’s formula). 


PROBLEMS 


39.1 The particles emitted by a radioactive substance in the 
disintegration process form a simple flow with parameter 4. Each 
particle can independently reach a counter with probability p. Deter- 
mine the probability that during time ¢ 7 particles will be recorded by 
the counter. 

39.2. Two communication channels feed two independent simple 
flows of telegrams to a given point. Find the probability that n telegrams 
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will arrive during time ¢ if the parameters of the component flows are 
A, and Ag. 

39.3. The electronic emission of the cathode of an electronic tube 
represents a simple flow of electrons with parameter A. The flight 
times for different electrons are independent random variables with the 
same distribution function F(x). Determine the probability that at time 
t after the start of emission there will be exactly 1 electrons between the 
electrodes of the tube, and determine the limiting probability of the 
same event. 

39.4 For a simple flow of events, determine the correlation 
coefficient between the number of occurrences in the intervals (0, ¢) 
and (0, t + 7). 

39.5 For a random time 7, of occurrence of the nth event in a 
simple flow with parameter A, determine the distribution function F,(¢), 
the probability density f,(¢) and the moments m,. 

39.6 Find the transition probabilities of a system from state Q; 
to state Q, in time ¢ in a homogeneous Markov process if, in a single 
change of state, the system can pass only from state Q, to state Q,41, 
and the probability that the system will change its state during time 
interval (t, t + At) is [AAt + o(Az)]. 

39.7 The customers of a repair shop form a simple queue with 
parameter A. Each customer is serviced by one repairman during a 
random time, obeying an exponential distribution law with parameter p. 
If there are no free repairmen, the customer leaves without service. 
How many repairmen should there be so that the probability that a 
customer will be refused immediate service is at most 0.015, if w = 4. 

39.8 One repairman services m automatic machines, which need 
no care during normal operation. The failures of each machine form an 
independent simple flow with parameter A. To remove the defects, a 
repairman spends a random time distributed according to an exponential 
law with parameter yw. Find the limiting probabilities that k machines 
do not run (are being repaired or are waiting for repairs), and the 
expected number of machines waiting for repairs. 

39.9 Solve Problem 39.8 under the assumption that the number 
of repairmen is r (r < m). 

39.10 A computer uses either units of type A or units of type B. 
The failures of these units form a simple flow with parameters A, = 0.1 
units/hour and A, = 0.01 units/hour. The total cost of all units of type 
A is a, and that of all units of type B is b (b > a). A defective unit 
causes a random delay, obeying an exponential! distribution law with an 
average time of two hours. The cost per hour of delay is c. Find the 
expectation for the saving achieved by using more reliable elements 
during 1000 hours of use. 

39.11 The incoming calls for service in a system consisting of n 
homogeneous devices form a simple queue with parameter A. The service 
starts immediately if there is at least one free device, and each call 
requires a single free device whose servicing time is a random variable 
obeying an exponential distribution with parameter pw (un > A). If a 
call finds no free device, it waits in line. 
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Determine the limiting values for (a) the probabilities p, that there 
are exactly & calls in the system (being serviced and waiting in line); 
(b) the probability p* that all devices are busy; (c) the distribution func- 
tion F(t) and the expected time ¢ spent by a device waiting in line; 
(d) the expected number m, of calls waiting in line, the expected number 
mz of calls in the servicing system and the expected number of working 
devices m, that need no service. 

39.12 The machines arriving at a repair shop that gives guaranteed 
service form a simple queue with parameter A = 10 units/hour. The 
servicing time for one unit is a random variable obeying an exponential 
distribution law with parameter p = 5 units/hour. Determine the 
average time elapsed from the moment a machine arrives until it is 
repaired if there are four repairmen, each servicing only one machine 
at a time. 

39.13 How many positions should an experimental station have 
so that an average of one per cent of items wait more than 2/3 of a 
shift to start, if the duration of the experiments is a random variable 
obeying an exponential distribution law with a mean shift of 0.2, and 
the incoming devices used in these experiments form a simple queue 
with an average number of 10 units per shift? 

39.14 A servicing system consists of n devices, each servicing only 
one call at a time. The servicing time is an exponentially distributed 
random variable with parameter ». The incoming calls for service form 
a simple queue with parameter A (un > A). A call is serviced im- 
mediately if at least one device is free. If all devices are busy and the 
number of calls in the waiting line is less than m, the calls line up in 
the waiting line; if there are m calls in the waiting line, a new call is 
refused service. 

Find the limiting values for (a) the probabilities p, that there will be 
exactly & calls in the servicing system; (b) the probability that a call 
will be denied service; (c) the probabilities that all servicing devices 
will be busy; (d) the distribution function F(t) for the time spent in the 
waiting line; (e) the expected number of calls , in the waiting line, the 
expected number of calls mz, in the servicing system, and the expected 
number of devices mz, freed from service. 

39.15 A barbershop has three barbers. Each barber spends an 
average of 10 minutes with each customer. The customers form a simple 
queue with an average of 12 customers per hour. The customers stand 
in line if when they arrive there are fewer than three persons in the 
waiting line; otherwise, they leave. 

Determine the probability p, for no customers, the probability p 
that a customer will leave without having his hair cut, the probability 
p* that all barbers will be busy working, the average number of 
customers 7, in the waiting line, and the average number of customers 
mz, in the barbershop in general. 

39.16 An electric circuit supplies electric energy to m identical 
machines, which need service independently. The probability that during 
the interval (t, + At) a machine stops using electric energy is wAt + 
o(At), and the probability that it will need energy during the same 
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interval is [AAt + o(At)]. Determine the limiting probability that there 
will be » machines connected in the circuit. 

39.17 A shower of cosmic particles is caused by one particle 
reaching the atmosphere at some given moment. Determine the 
probability that at time ¢ after the first particle reaches the atmosphere 
there will be » particles, if each particle during the time interval 
(t, t + At) can produce with probability [AtA + o(At)] a new particle 
with practically the same reproduction probability. 

39.18 A shower of cosmic particles is produced by one particle 
reaching the atmosphere at some given moment. Estimate the proba- 
bility that at time ¢ after the first particle reaches the atmosphere there 
will be n particles, if each particle during the time interval (t, ¢ + At) 
can produce a new particle with probability (AArt + o(Ar)] or disappear 
with probability [uAt + o(Ar)]. 

39.19 In a homogeneous process of pure birth (birth without 
death), a number of # particles at time ¢ can change into” + 1 particles 
during the interval (¢, ¢ + At) with probability A,(¢)Ar + O(Ar), where 


+a, 
+ at’ 





An(t) = 


or they can fail to increase in number. Determine the probability that 
at time ¢ there will be exactly n particles. 
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Basic Formulas 


A continuous stochastic process U(t) is called a Markov process if the 
distribution function F(u, | w4,...,U,—1) of the ordinate of U(r) at time ¢,, 
computed under the assumption that the values of the ordinates u,, Ua,..., Un—1 
at times ¢, fo,...,f,-1 are known (ft, < tg <--:< t,_1 < t,), depends only 
on the value of the last ordinate; i.e., 


Eis | Wises they) = FO |i) 


The conditional probability density f(u, | u,_1) is a function f(t, x; 7, y) 
of four variables, where for the sake of brevity one uses the notations: 


UG) =x, U(7) = Y, t<r. 


The function f(t, x; 7, e satisfies the Kolmogorov equations? 


us + a(t, oe = Lt 3 5 ott, x) 5-3 of = 0 (the first equation), 
ge By [a (7, yf] - ins [d(7, y)f] = 0 (the second equation), 





2 The second Kolmogorov equation is sometimes called the Fokker-Planck equation 
or Fokker-Planck-Kolmogorov equation since before it was rigorously proved by Kolmo- 
gorov it had appeared in the works of these physicists. 
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where I 
a(t, x) = lim ——— M{LY — x] | = x}, 


‘ 1 
b(t, x) = lim —— Mi[y - X]}? | X = x}. 
The function f(t, x; 7, y) has the general properties of the probability density: 
fexiny>0, fo faxinydy=1 


and satisfies the initial condition 
S(t, x; 7,y) = &y — x) for r=t. 
If the range for the ordinates of the random function is bounded, that is, 
a < Ut) <B, 


then in addition to the previously mentioned conditions, the function 


Gry) = ale NF 5 5 W W 


should also be constrained by the following boundary conditions: 
G(r, «) = G(r, 8) =0 forany +r. 


(G(r, y) may be regarded as a “probability flow.’’) 

A set of n random functions U,(t),..., U,(t) forms a Markov process if 
the probability density (distribution function) ffor the ordinates Y,, Yo,..., Yn 
of these functions at time 7, calculated under the assumption that at time 
the ordinates of the random functions assumed the values X,, Xo,..., Xn, iS 
independent of the values of the ordinates of U,(t), U2(t),..., Un(t) for times 
previous to ¢. In this case, the function / satisfies the system of multidimensional 
Kolmogorov equations 


a é 
Ly, pS a,(t, oe eee 


xj 


Lc 


re. . 
+5 > byt, X15 Xa. - +5 Xn) DOx (first equation), 
XjOX, 


af & @ 
ant Dy, Mody WI 
LS 
me Pee By,oy, lon(t, Vi, ---5 Va) f] = 9 (second equation), 


where the coefficients a, and b,, are determined by the equations 


1 
2 Cn Xn) = lim —— MI(¥; XY | Xe Pika ke = eds 


MIC; a XY, ~~ xX) | Xx, FS Xi, - 0s AG = Kal 





b(t, X1y+ 
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and the initial conditions 


TOs LSC, X16 023 %Xn5 T, Viy-- aga) = 61 =. X1)8( 2 = Xp): “80a _ Xn). 


Given the differential equation for the components of a Markov process 
U,(t), U2(0),..., Un(t), to determine the coefficients a; and 5,, (a and 6 in the 
linear case) one must compute the ratio of the increments of the ordinates of 
U,(t) during a small time interval to (+ — ¢), find the conditional expectations 
of these increments and of their products and pass to the limit as 7 — ¢. 

To any multidimensional Kolmogorov equation, there corresponds a 
system of differential equations for the components of the process 


au, x 
Gyr Ys Urs. Un) + D, Binkts Urs, UndEn(t), 
m=1 
aa er errs | 


where €,,(¢) are mutually independent random functions with independent 
ordinates (“‘white noise”) whose correlation functions are K,(7) = 6(7), and 
the function #, and g,,, are uniquely determined by the system 


2 8158im = Dims Biz = Bi 
oy = a 


To solve the Kolmogorov equations one can use the general methods of 
the theory of parabolic differential equations (see, for example Koshlyakov, 
Gliner and Smirnov, 1964). When a, and ,, are linear functions of the ordinates 
U(t), the solution can be obtained by passing from the probability density 
S(t, X15 - ++) Xn3 T: 1s +++, Vn) to the characteristic function 


, Ce, eas Cea 3 


Gna | af SpUCy a oua eo 


RTE, May say Rips T, Vaiss ++) Yn) r++ dyn, 


obeying a partial differential equation of first order, which can be solved by 
general methods.’ 

If the coefficients a,, 5), are independent of ¢, then the problem of finding 
the stationary solutions of the Kolmogorov equations makes sense. To find the 
stationary solution of the second Kolmogorov equation, set éf/é7 = 0 and 
look for the solution of the resulting equation as a function of )4, Yo,..-,)n 
only. In the particular case of a one-dimensional Markov process, the solution 
is obtained by quadratures. 

Any stationary normal process with a rational spectral density can be 
considered as a component of a multidimensional Markovian process. 

The probability W(7) that the ordinate of a one-dimensional Markov 
process during a time 7 = 7 — ¢ after a time ¢ will, with known probability 
density fo(x) for the ordinates of the random function, remain within the 
limits of the interval (a, 8) is 


B 
2 W(T) = i w(7, y) dy, r= f+T, 


a 
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where the probability density w(z, y) is the solution of the second Kolmogorov 
equation with conditions: 


w(t, Y) = foly) to r=0, 
w(t, «) = w(7,8) =90 to r2t. 


When the initial value of the ordinate is known, fo(y) = 5(y — x). The proba- 
bility density f(T) of the sojourn time of a random function in the interval 
(«, 8) is defined by the equality 


Bo 
fr) = -[ WEY) 5, T=7-t. 

ie Or 

The average sojourn time T of the random function in the interval (a, B) is 
related to w(r, y) by T = i W(T) dT. For « #00, B =o, the last formulas 
give the probability W(7) of sojourn time above a given level, the probability 
density f(7) of the passage time and the average passage time T. 

The average number of passages beyond the level « per unit time for a 
one-dimensional Markov process is infinity. However, the average number n(7,) 
of passages per unit time for passages with duration greater than 7) > 0 is 
finite, and for a stationary process it is defined by the formula 


n(rs) = f(e) [ v(ros ») dy, 


where f(a) is the probability density for the ordinate (corresponding to argu- 
ment «) of the process and v(7, y) is the solution of the second Kolmogorov 
equation for a stochastic process with conditions: 


tT <1, v(t, y) = 0; 7 >t, v(7, a) = Sr — 2), 
which is equivalent to the solution of the equation for the Laplace-Carson 
transform o(p, y). For a stationary process 
= [5 G0 — a] = po od =p for = b= 0 for = 0 
oy 2 ay = po, = Pp o ya, v= .e) y= * 
The transform of n(7,) is 


e 22-5) a(bd) 
A(p) = =a oy 





eis S(e)a(a). 


The probability W(7) that the ordinate U,(t) of a component of a multi- 
dimensional Markov process will remain within the interval (a, 8) if initially 
the distribution law for the components U,(f), U,(t),..., U,(t) is known, is 
defined by the equation 


ive] wo B 
wr) = | af | W(7s Vass Vn) Wie Wn-1 Dn, Tart, 
where w(7, ¥1,.--; Yn) is the probability density that the components of the 


process reach a volume element dy, - - - dy, at time 7 under the assumption that 
during the interval (t, 7) the ordinate U,(t) has never left the limits of the 
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interval (a, 8). The function w(r7, y1,..., ¥,) is the solution of the second 
Kolmogorov equation with the conditions 


W(T, Vis ++ +s Vn) = fois -- +5 Vn) for T=; 


W(T, &, Yor. ++» Yn) = WT, B, Yo, ---> Yn) = 0 for TZ. 


The probability density f(T) of the sojourn time of U,(t) in the interval 
(a, 8) is defined by the formula 


eal ae oT. [Meet ay. + dn-1 Wn, 


T=r7Tr-—t. 


In the last formula, « can be —oo, or 8 can be +00, which correspond to 
probabilities of sojourn time neither above nor below a given level. 


SOLUTION FOR TYPICAL EXAMPLES 


Example 40.1 Write the Kolmogorov equations for a multidimensional 
Markov process whose components U,(t), U.(t),..., U,(t) satisfy the system 
of differential equations 


d Ux ) 





= ¢,(t, Uy,..., Un) + c,€(t), | oe be eee 


where ¥, are known continuous functions, c, are known constants and &,(t) are 
independent random functions with the property of ‘‘ white noise”’; that is, 


&(t)=0, — Kz,(7) = &(7). 


SOLUTION. To write the Kolmogorov equations, it suffices to determine 
the coefficients a, and b;, of these equations. 

Denoting by X; the ordinate of the random function U,(t) at time ¢ and 
by Y;, its ordinate at time 7, and integrating the initial equations, we obtain 


Via | Mle B25 UNS [ sean. 


Considering the difference + — ¢ small, we can carry ¥; outside the first integral 
with a precision up to second order terms and set t; = T, U; = X, Up = Xo, 
, U, = X,, which leads to 


Y; = X; = w(t, Xi, veg Xn)(r = t) + C; [ E(t;) ar: 
that is, 
Y; — X; 


eee f = u(t, Kye atig Xs 1) dt,. 





Assuming that the random variables X;,..., X, are equal to x,,..., X,, finding 
the expectation of the last equality and passing to the limit as 7 — t, we obtain 


GK xi 2i8e = ee 
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Multiplying the expression for (Y; — X,) by that for (Y, — X,) and finding the 
expectation of the product obtained, we get 


M((Y; — X,)(% — X) | x... +s Xal 
SP: i RE By ANE HO? eee [ I * 8(tg — ty) dty dly 
Sh Nes eae ea UE Mis sch Ar St) Fees STs 
which after division by (r — ¢) and passage to the limit gives 
DAE Ries OE) = Cer 


Example 40.2 Given the first Kolmogorov equation for the conditional 
probability density f(t, x1, X23 7, ¥1, ¥2) of a normal Markov process, 


ie ee 2 of 2 Of _ 
ai 2 Ox, ~ (Kx, + hx) gE + 508 ox2 


> 


determine the system of differential equations satisfied by the components 
U,(t) and U,(t). 


SOLUTION. According to the notations, for the coefficients of the Kolmo- 
gorov equations we have 


a, = No; ag = —k*x, = 2hXe, by — Dy» = 0, Des => a. 
The required system of equations has the form: 


oe = #(t, Uy, U2) + > Sint, Uy, Uta), 2 = 1,2; 


where €,,(t) is the ‘“‘white noise”’ with zero expectation and unit variance. By 
the general formula given in the introductory section, p. 258, we have 


gir + Si2 = 0, B11812 + £12822 = 0, 


Sia + £2 = 07, wy, = a). 
Consequently, 


8 = 812 = 0, S22 = 9, by = Xe, Po = —k?x, — Lhxo, 
and the required system has the form 


oUt) _ 


ai 


= U,(t), 


CCAD _ _1h2U,(1) + 2AUAA1)] + o8(0), 
Eliminating U.(t) from the last equation, we obtain for U;(t) a second-order 
equation 
eal OF 
ot? 


2 








+ 2h + k?U, = of€(t). 
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Example 40.3 A normal stationary process U(t) has the spectral density 
| Pm{ iar) |? 

| On(iw)|? 

Pr(x) = Box™ + Byx™-? +-+-+ Bras 


O,(x) = x” + ayx™ 72 +--+ + on, n>m, 


S,(w) = 


where 


and «, and f; are known constants. Considering U(t) as a component of a 
multidimensional Markov process, determine the coefficients of the Kolmogorov 
equations of this process. 


SOLUTION. A stationary normal random function with rational spectral 
density is the solution of a linear differential equation, containing “white noise” 
on the right side. In the present case the equation has the form 


d"U atu & dts haan 3 
We + 4 Qype tess aU = Bote + Bi Gmmt +--+ Bre. 


We turn from the nth order equation containing the derivatives of &(t) on its 
right side to a system of equations of first order without derivatives of é(¢) on 
the right side. Let U(t) = U,(t), and introduce new variables defined by the 
equalities: 

U, = U,, U3 = Ua, aE} Un—m =; Diced 


Oran = Onan =7 Choe. cere _ CO at = Ceemaae. 


U, = Us im Cpe, 


where c, are arbitrary constants for the time being. The foregoing equations 
form a system of n — | equations of first order. To get the last (mth) equation, 
in the initial nth-order differential equation it is necessary to express all deriva- 
tives of U in terms of U, and their first derivatives. Performing these trans- 
formations, we obtain 


dU, 


dt + aU, apes a,U, oh eager? 





Alea sqar ce Oyeyeg oe" . (Cae mee enna 
+ a ee aes Ss ee + (enx4 + &1Cn-92 + AoCy 3 7 aaa 
+ Cp Ca Sey Ge oF (aC, -14 + OCpig Tere t Onn ows 
= Bof™ + Bid" +--+ + Baia’ + Bug. 
Determining the coefficients c; so that the derivatives of &(t) disappear in the 
equation, we find the recursion relations 
t-1 
C= Biem-n — 2 O)  7Cj, l=n—~m,...,n— 1, 
=n-m 


which for the last equation of the system gives 


aU, ey 
dt + aU, se eo ee oC Cr = Bm — > On — 5C;- 





~ 
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Since the components of an n-dimensional process satisfy a system of first- 
order equations on the right sides of which there is the “‘ white noise,” the process 
is an n-dimensional Markov process. The coefficients of the Kolmogorov 
equations are determined as in Example 40.1. 


Example 40.4 The conditional probability density f(t, x1, X23 7, ¥1, Ye) of 
a two-dimensional stochastic process U,(t), U2(t) satisfies the equation 


LS Of) - Oa — 355 EVITA — 5 a eVT FIN = 0, 


where ea and f are constants. 
Determine the system of differential equations satisfied by U,(t) and U,(f). 


SOLUTION. The given equation represents the second Kolmogorov equa- 
tion and, consequently, the process is a two-dimensional Markov process. 
The coefficients of the equation are 


a, = —By2, ag = —ay1, by = pv1 + y3 
boo = aV1 + yi, bye = 0. 
The required system of equations has the form 


dU - 
a = P(t, U,, Ue) a > Lint, U;, Ua)En(t), 
m=l1 





dU . 
ae — w(t, Ui, U2) + > Senlt, U,, UnEn(t), 
m=1 


where &,(t) and &,(t) are uncorrelated random functions of the ‘“‘ white noise” 
type with unit variance. According to the general theory, to determine g,, one 
should solve the algebraic system of equations 


eel + Sis = BVI a Y25 831 at 852 =aVI - yi, 


£11812 + 812822 = O. 
Hence, it follows that 


812 = 0,7 811 = VBVI + y3, §22 = Vavi + yi, 
t1 = —Bye, 2 = —ay,. 


Consequently, the required system has the form 





an fie BU, = = VevV1 + U2 + U2 E,(t), 
w a aU, <= Vavl + U2 E(t). 


Example 40.5 Determine the asymmetry Sk and the excess Ex of the 
ordinate of a random function Z(¢) defined by the equality 


aZ(t) 


Se + ZO) = FW), 
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if ¢(t) is a normal random function, ¢ = 0, K,(r) = o?e~*'! and the transient 


phase of the process is assumed to have ended (compare with Problem 35.29). 
SOLUTION. Since the spectral density 


1 


Sw) = a> 


is a rational function of frequency, ¢(f) satisfies the equation 


Hs atmo fH), 


where &(f) is “white noise” with zero expectation and unit variance. Therefore, 
considering a two-dimensional stochastic process with components U,(t) = Z(t), 
U(t) = &(t), for the conditional probability density f(t, x1, X23 7,1, Yo) of 
this process we obtain the second Kolmogorov equation in the following form: 


2. 2 lod — My fl — @ Oaf) - 00? = 


For the stationary mode f(t, x1, X23 7, ¥1, Vo) = f(y, Ye) and the Kolmogorov 
equation becomes 


ip lot — By fl - ax ~ (af) - ao? Sno: 


According to the assumption of this problem, it is necessary to determine the 
moments m, of the ordinate of Y,(t) up to the fourth, inclusive. The required 
moments relate to the two-dimensional probability density f(),, y2) by 


mm, = | ik VIAOnv Ye) D1 Do = | xi(Y2) deo, 


where 
XK ye) = [ Vif Wr Ye) ayy. 


Multiplying both sides of the Kolmogorov equation by y}, integrating the result 
with respect to y, with infinite limits, and taking into account that 


[orig 108 - MyofOu vol ds 
= yids — ky fn, Vo) |2 ov = | yy "(ye — Kyi) fr ye) a1 
= k?lx(Yo) — lyexi-1(¥2)5 

we obtain a recursion relation between y,(y,) and y,_1(2): 


dy d 
7 Bi “f “Dn (Vox) _ k?ly, ar —ly3x1-1- 


4 ao 
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Multiplying both sides of the last equality successively by 1, y3, y§ and y8, 
integrating by parts and eliminating all zero terms that appear outside the 
integral, we get a series of equations: 


l fo) 
m= z| y3x1-1(2) dy, 


] oO 
Mar = k*(k?1 + 2a) {1 I Vx1-1(V2) dyo + Dao? 


1+1 
KAR + 4a)[( + Nk? + 2a] 


* 2ao7(6k2 + 7k71 + 4 
x {rf Y8X1-1( 2) Wo + PEE AD) miss} 


f+] 
(ee ies) 
+3 FaK2T + bay(kel + k? + 4a)[k*0 + 2) + 2a] 


x {1 iz y8y,-a(2) dr 


4, Daterl(13K? + 721 + 4a)(K2U + 6ei) + 15K2(K21 + k2 + 2a(L + 2)Mnig 
7+ D0 + 2D 


Miso = 


Setting / = 1 in these equalities, we can express the four moments in terms of 
Xo( 2). Because of the normality of function Y.(7r) = &(7), 


xo) = [F022 dr = f0) = eer {- 25 1- 


Consequently, all the integrals appearing in the preceding equalities can be 
computed and the result coincides with that of Problem 35.29, which is solved 
in a more complicated manner. 


Example 40.6 Determine the conditional probability density f(t, x1, ..., X23 
T, Yip -++s Yn) Of a multidimensional Markov process if in the second Kolmo- 
gorov equation 


of 2 ae 
a af) — eae. ay ,OV, 7 (6.f) = 


the coefficients b,,, are constants, the coefficients a; are linear functions of y;: 


nr 


a= % + 2, di» Lj= Lyng Ms 
J= 


and the range of y, is (—00, 00). 


SOLUTION. By assumption, the solution must satisfy the initial condition 


f= 118 - 2) for r=t 
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and the condition that f vanishes as | y,| 90, and ‘ee vee [of ay --- dy, = 1 
for any 7. 

We now turn from the probability density f of the system of random 
variables Y,, Y2,..., Y, to the characteristic function 


E(Z,, Za, -++) Zn) = | i exp {i > ahha AV as 
-2 —© l=1 


For this purpose, we multiply both sides of the second Kolmogorov equation 
by exp {i >?_, z,y,} and integrate with respect to y,, yo,..., Y, between infinite 
limits. 

Since 


[i few : Ziv} we (af) dy, dy 
-o —@ =1 
= -if 3 a > zvibeaf by eV 





ope ay fk 
i- aes ie Byoy, exp (- ‘ ad dy,-+- dy, = —2;2,E, 


the equation for E has the form 


Letting E = exp{—V}, we get for V the ie 


n 


V ri 


j,lsl 
which according to the initial conditions for f must be solved under the 
conditions 


nr 
T= tf, Vai 2 2X). 
j= 


From the general theory, it is known that the distribution law for the 
process considered is normal. Therefore, we seek the solution for V in the form 
of a second-degree polynomial of z,, that is, 


1 nr n 
>> Fs ky2;2, — i > Vi235 
a t=1 j=l 


where k,, and y, are real functions of 7. To determine these functions, we 
substitute the last expression in the differential equation for V and equate the 
coefficients of equal powers of z; in the left and right sides. We find 


GU, l= bya A) 





* a 2 Lim Km — = by 
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The system of equations for j, is independent of &,, and should be solved with 
the initial conditions: + = t, ¥, = x,;. The system of equations for k,, is inde- 
pendent of y, and should be solved with the initial conditions: + = ¢, kj, = 0. 
From the general theory of linear differential equations, it follows that y, and 
k,, are linear combinations of exponential functions of form e**~, where A are 
the roots of the corresponding characteristic equation (in case of multiple 
roots, the coefficients in the exponent can be polynomials of 7). The general 
formulas can be obtained by matrix operations. 


Example 40.7 Find the conditional probability density f(t, x; 7, y) for a 
process defined by the equation 


of 6G a” a? Of 
Or (2 ~ 3)/| - 5 a =o ei 
if « and 6 are constants. 


SOLUTION. We apply the Fourier method; 1.e., first we seek two functions 
%(r) and y(y) whose product satisfies the given equation independent of the 
form of the initial conditions. Substituting them in the equation, we get 


pe tw (OH) ] + 3 


Since the left side of the equality is independent of y and the right side is inde- 
pendent of +, both sides must be equal to a constant, which we denote by A, 
obtaining 


at Ab =0, 


2 qd2 d 2 
G+ $ [lo - Sh] oxne 


The first equation has the obvious solution 


Wa) = er N-9. 
The second equation has a solution vanishing at infinity only for discrete 
values of 4 = 2n8, n = 0,1,.... In this case, the equation for y(y) has the 


solution 


x) = 4exp {-35}4 (25); 


where L,(x) = e* d"/dx” eed are the orthogonal Laguerre polynomials, and 
a? = «7/28, Since the functions Y(7) and y(y) depend on the integer n, the 
solution f of the initial differential equation can be found as a linear combination 
of the products of these functions; that is, 


JG ey = > Cn exp {—2nB(r — ee = Jem {- 3h1,(35)> 


where the coefficients c, should be such that for + = #, the function f(t, x; 7, y) 
becomes d5(y — x), that is, 


2,em ae {as} h(3z) 


d(y — x). 
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To determine the constants c,, it is sufficient to multiply the last equation by 


y ye 
vexw | —~ga}tel 3) 


and to integrate with respect to y between the limits (0, 00). Using the ortho- 
gonality of the Laguerre polynomials and the properties of the 6-function, we 


find that 
_ix ales (35): 
on = n! o? oaD 207) ~"\207)’ 
that is, 
xy © cides Ee ee 
Cae 9) = exp {— Io? } 


x S way Eo Soa) L(33) exp {—2nB(r — t)}. 


n=0 





Example 40.8 Find the probability W(+) that the ordinate of the process 
U(t) defined by equation dU/dt + «U = &(t), where Sw) = c? = const., 


€ = 0 at time 7 never exceeds the level y = 0, if for t = 0, U(t) = —B; B > 0. 


SOLUTION. The probability density w(r7, y) that at time 7 the ordinate 
of the stochastic process, which never exceeds the zero level, will lie on the 
interval (y, y + dy) is defined by the second Kolmogorov equation 

ow 7) c? 0?w 

eo en," “a oye = 0, 
which in the present case should be solved for y < 0 with the conditions: 
w(r, y) = &(y + B) for + = 0; w(r7, 0) = 0 for any +r. The required probability 
is 


Wo) = [wr y) dy, 


To simplify the coefficients of the equation, let us introduce nondimensional 
variables 


1 =0T, YW=—y, 


after which the equation becomes 


1 6?w 7) 
a —_— = ——] = 0; 
2 oy? 23 V1 (yi) OT 


Vv 
w(n, Yi) = (v1 + Bs) for n= 0, 


(11,0) = 0 for 7, > 0, where 8, = Va/c B. 
Solving this equation by the Fourier method and setting w(71, ¥1) = 
¥(71)x(V1), we obtain for (71) and y(y1) the equations 


1 dp ge 10h oe ax 2 = 
~— = — —; —— + 2(A? + Dy = 0. 
b dr, A ) dye * V1 Dy, ( )x 
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The first equation has the obvious solution ¢(7,) = exp {—A?7,} and the second 
one has finite solutions at infinity only if A? = n (n = 0, 1, 2,...), when 


x(1) = exp {-y} AA), 
where 


d”™ 
HQ) = (=I exp (93 SS exp {-yB) 
V1 
is the Hermite polynomial. Consequently, the solution must be sought in the 
form 
w = exp {yi} >, ag exp {nn} (1). 
Since for y; = 0, w must vanish for any 7,, the series can contain only poly- 


nomials H,(y,) with odd indices (H2,.4,(0) = 0, H2,(0) # 0 for any integer 
k > 0). Therefore, the solution should be of the form 


w = exp {—yi} a Aox+1 xp {—(2k + 1)t1}Hex+i(y1)- 


To find the coefficients a2,,,, it is necessary to fulfill the initial condition; 
that is, 


eck Va 
exp {— yi} > Qox+1Hox+1(Vi) = oa 8(y1 + Bi), yi <0. 
k=0 


This condition is equivalent, for the range (—oo, +00) of ),, to the condition 


exp {— yi} > 42% 41H 410%1) = Ma 8(y1 + Bi) — 2 5(y1 — Ai). 


Multiplying both sides of the last equality by H2,,,()1), integrating with respect 
to y, from —o to +o and considering that 


i e-*? H.(x)Ha(x) dx = 2"!V a Sinn 


(dan = 1, 8nn = 0 for n # m), we obtain 


I Va 
DUD + DIV a ry Diva ¢ fares). 


[on41 = 


Thus, 


w = —exp{—y} > exp{—(2k + 171} 
K=0 
Va 
— H. H : 
a 22k + 1)IVae 2x +1(81) 2n+1(V1) 


Returning to variables y and 7, we find 


w(t, y) = ~~ s exp {—(2k + 1)ra} exp {-% y} 


x sage Howe M8 s(“E2). 
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Substituting the resulting series in the formula for W(7) and considering that 


2 Pe 
| exp {=F} Hace ou) Me ay 


18) 
= il exp {—y3 Hous iQ) dy, = (— DEH 





(2k)! 
kt 
we obtain that 


: Va 
W(x) = Je > exp {Qk + Ive) saree aye Hane") 


PROBLEMS 


40.1 Find the coefficients of the Kolmogorov equations for an 
n-dimensional] Markov process if its components U,(t), U2(t),..., Un(t) 
are determined by the system of equations 


dU, 
“FH = Yb Ua) Un) + lb, Uys) UDEM), 


PH 126430 


where ys, and y; are known continuous functions of their variables and 
&,(t) are independent random functions with the properties of ‘‘ white 
noise”’: 

s, = 0, Kz(7) = 8(7). 


40.2 Given the system of differential equations 


du, 


“dt = ¥,(t, Oise Gayz)s J= 1, Qe cd, Ms 


where yw, are known functions of their arguments and Z(t) is a normal 
stationary stochastic process with spectral density, 


Cc? 


S.(w) = Grays’ 


add to the multidimensional process U,(t),..., U,(t) the necessary 
number of components so that the process obtained is Markovian. 
Write the Kolmogorov equations for it. 

40.3. Suppose U(t), a stationary normal process, is given with 
spectral density 


C2 Ww? 


Sia) = 
u(w) [(w? cr ee B22 = 487?) 
where c, « and § are constants. 
Show that U(t) can be considered as a component of a multi- 
_dimensional Markov process. Determine the number of dimensions of 
this process and the coefficients of the Kolmogorov equations. 
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40.4 Determine the coefficients of the Kolmogorov equations of a 
multidimensional Markov process defined by the system of equations 


dU 
are = 9b, Ui, sey U,) + Z(t), 
where 
Z,(t) = 0, M[Z,(OZ,(¢ + 7)] = ¥,()8(7), 
Ped = Ny Qe ecg ht 


and g, and ¥,, are known continuous functions of their arguments. 
40.5 The random functions U,(t) satisfy the system of differential 
equations 


dU, : 
ae $= Ol Oy, 556) Oy Zs on eens a 


where », are known continuous functions of their arguments and Z(¢) 
is a stationary normal random function with rational density 


bes — {Pnliw)|? 
Z= 0, S.(w) = 10,(ia) |?” 


n>m, 


where the polynomials 
Pal t) = Por Pee See Be 
On(x) = X® + ax) + +++ + Oy 


have roots only in the upper half-plane. 
Show that U,(t),..., U,(t) can be considered as components of a 


multidimensional Markov process, determine the number of dimensions 
and the coefficients of the Kolmogorov equations of this process. 
40.6 Show that if the Kolmogorov equations 


£4 x |(c > )e] Ss a GHz 
s- a, —_—_ = 
Or #4 YY; : m=1 oe 2g ae ey; OVsOVm ” 
where «,, am, Ojm (J, m = 1, 2,...,) are constants, hold for a multi- 
dimensional Markov process, then the stochastic process satisfies the 
system of differential equations: 


du; 2 ; 
ar + Cp = Be); Fe — 2 tee renee 2 
m=1 


where 


1; = %}, K,,(7) = b,,;8(7), Ray (7) = jn 8(7). 


40.7 Derive the system of differential equations for the com- 
ponents of a two-dimensional Markov process U,(t), U.(t) if the 
conditional probability density f(t, x1, X23 T, V1, Ye) satisfies the equation 


Fn H+ o£] - 2 [Ron + $F] -o. 
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40.8 Determine the distribution law for the ordinate of a random 
function U(t) for the stationary mode if 


d?U 2 dU 
qe + 5 gp t CU) = &), 





where « is a constant, p(U) is a given function that ensures the existence 
of a stationary mode and 


&t)=0, Ker) = 0787). 
Solve the problem for the particular case when y(U) = 8?U%. 
40.9 Determine the stationary distribution law for the ordinate 
of a random function U(t) if 


a =U) + WU), 


where g(U) and ¥(U) are known functions and &(t) represents “white 
noise’ with zero expectation and unit variance. 

40.10 A diode detector consists of a nonlinear element with 
volt-ampere characteristic F(V) connected in series with a parallel RC 
circuit. A random input signal {(¢) is fed to the detector. Determine the 
stationary distribution law of the voltage U(t) in the RC circuit if the 
equation of the detector has the form 


dU ] ies 
de Re ee 


where R and C are constants and &(t) is a normal stationary function 
for which 


S T 
i) =0, Kir) = otexp {th 
Solve the problem for the particular case in which 


Fv) kv, v20, 
v= 
0, v< 0. 


40.11 Determine the distribution law for the ordinate of a 
random function U(t) for time 7 > 0 if 


dU ao : 
Oe = aU = oft), §=0, K (7) = ad(7), 


x xe 
So(x) = 20x {sa} U(it)= X for t=0 (x 20). 


40.12 An input signal representing a normal stochastic process 
¢(t) with a small correlation time is received by an exponential detector 
whose voltage U(t) is defined by the equation 

dU 1 


ee 
— U= -e% 2, 


a * RE 


40. 
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where R, C, a, ig are the constants of the detector, = O and 
Kr) => o%e~altl 
Using the approximate representation 
eve — M[e%*®] + é(t) 
and considering that 
&(t) = eat) _ M [et] 
is a 5-correlated process, 
Kr) & of8(7), 
where 


ot =[ Ken) dr, 


determine the stationary distribution law for the ordinate of U(t). 
40.13 A stochastic process U(t) satisfies the equation 


dU 
at 


where ¢(U) is a given function, f(t) represents ‘“‘ white noise’’ with zero 
expectation and unit variance, and for a given form of the function g(U) 
a stationary mode is possible. Determine the probability density f(y) 


of the stationary mode. 
40.14 A random function U(t) satisfies the equation 


= —(U) + o&(t), 


=a = oft) + B(L)U + y&(t) 


with initial conditions 7 = t, U(t) = x. 

Find the distribution law for the ordinates of this random function 
for time 7 > t if a(t), B(t) and y(t) are known functions of time and 
é(t) is ““white noise”? with zero expectation and unit variance. 

40.15 The deviation of the elevator of an airplane is communi- 
cated to the automatic pilot to eliminate the effect of wind pulsations 
characterized by a random function <(t). The signal is approximately 
described by the differential equation 


A 
foe +A aa ige(t), 


where 7, and iy are constants. 
Determine the conditional probability density f(t, x; 7, y) of the 


ordinate of the random function A(t) if the expectation é(t) = 0 and 
one may approximately consider that K,(r) = o28(7), and A =x 


for-7 St. 
40.16 The incoming random perturbation at the input of a system 


of second order is described by ¢(t): 


PU. dU. ay 
qe + tha + eu =), k>h>O. 


274 MARKOV PROCESSES 


Determine the conditional distribution law of the ordinate of the 
stochastic process U(t) at time 7 > ¢ if at time t, U(t) = x, U(t) = 0, 
f(t) = 0, K,(r) = c?8(7); c, h, k are known constants. 

40.17 The equation defining the operation of an element of a 
system of automatic contro] has the form 


a = —asgn U + c&t), 


where a@ and c are constants and 

&(t)=0, Ker) = (x). 
Write the Kolmogorov equation for the determination of the conditional 
probability density /(t, x; 7, y). 

40.18 A moving charged particle is under the influence of three 
forces directed parallel to the velocity vector U(t): the forces created by 
the electric field of intensity &(t), the accelerating force created by the 
field whose intensity can be taken inversely proportional to the velocity 


of the particle and the friction forces proportional to the velocity. The 
motion equation has the form 


a = BU: Z + o€(t). 

Find the probability density f(t,x;7, y) for the magnitude of the 
velocity U(t) if «, 8 and y are constants and &rt) = 0, K-(r) = &(7); 
the mass of the particle is m. 

40.19 A radio receiver can detect a random input noise U(t) 
only if the absolute value of the signal is greater than the sensitivity 
level of the receiver uw). Determine the probability W(7) that during time 
T no false signal will be received if U(t) is a normal stochastic process 
with zero expectation and with correlation function 


Kit) = oe *"", 


where uo, « and o are constants and U(t) = 0 for t = 0. 

40.20 A radio receiver can detect a random input noise U(t) if the 
signal (not its absolute value) is greater than the sensitivity level uy of the 
receiver. Determine the probability W(T) that during time T no false 
signal will be received if U(t) is a normal stochastic process with zero 
expectation and with correlation function 


K(t) = o%e-#!*1, 


where uo, « and o are constants and U(t) = O fort = 0. 


LX METHODS OF 


DATA PROCESSING 


41. DETERMINATION OF THE MOMENTS OF RANDOM 
VARIABLES FROM EXPERIMENTAL DATA 


Basic Formulas 


The approximate values of the moments of random variables obtained 
by processing the experimental data are called estimates (fitting values) of these 
variables and are denoted by the same symbols as the estimated numerical 
characteristics of random variables, but with a tilde above (for example, 
M[X] = %, DLY], £,.,, &,, and so forth). The set of values (x1, x2,..., X,) for 
a random variable X, obtained in n experiments, is called a sample of size n. 
It is assumed that the experiments are performed independently under the same 
conditions. If the sample size n tends to infinity, the estimate should converge 
in probability to the parameter being estimated. The estimate is called unbiased 
if, for any sample size, its expectation coincides with the required parameter. 
The unbiased estimate for the expectation is the arithmetic mean, 


g=15 y= C+2> @-O, 


nO 


j=l 
where C is an arbitrary number introduced for convenience in computations 
(‘false zero’’). 
If the expected value is unknown, the unbiased estimate of the variance 
will be 
bixj=— Sw - = Sw - or - 4 
n-14,~" n-14,°% n—1 
If the random variable considered is normally distributed, then the un- 
biased estimate of the standard deviation is given by the formula 











(% — C)?. 








Z15 
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TABLE 23 


3 1.1284 10 1.0280 30 1.0087 
4 1.0853 12 1.0230 35 1.0072 
5 1.0640 15 1.0181 40 1.0064 
6 1.0506 20 1.0134 45 1.0056 
7 1.0423 25 1.0104 50 1.0051 


The values of the coefficient k, are included in Table 23. 
If the expectation is known, the unbiased estimate of the variance is 


Bix} = + > Ga 


If x1, yi,.--; Xn, ¥n are the values of the random variables X and Y, 
obtained as a result of m independent experiments that are performed under 
identical conditions, the unbiased estimate of the covariance of these random 
variables is 
1 n 
> (x; — X)(y; — 9), 


kai 
od oe 





for unknown expectations X and Y; 


hw =2 > Gs ~ DOV- I), 


mn 
if 
ay 


for known expectations. 
The estimate of the correlation coefficient can be found from the formula 


. ka. 


lay = 





 6Gy 

For a large sample size the elements of the statistical series are combined 
in groups (classes) by representing the experimental data in the form of an 
ordered array (Table 24). 


TABLE 24 





Class No. 








Limits of the class x; — x; 
The mean value x7 of the class 
Size m, of the class 


Frequency p} = m,/n of the class 





11f the variable considered is normal, then the unbiased estimate for the standard 
deviation is determined from the formula 


@ = kasi a 
Nye 


41. MOMENTS OF RANDOM VARIABLES 241 


In this case, the estimates for the expectation, variance and moments of 
higher order are approximately determined by the formulas: 


XD 


TMs 


K yk 
Pe 


D[X] = 


nx 


P OF a X)*p*, 


k 
alX] & 3 Of — DF, 
~ k 
il X] = > OPH, 


or more precisely (taking into account the Sheppard corrections) by: 
k 
mK] > otph, 
i= 


2 B h? 
fel X] & > OPK — FF 


26k 


Zs x h 
fnelX] & 3 CPF — GD appr, 


miX] 2 > Ot — © 5 Coppe + ZE 
4 ~ Fan 3) Pj 5 =- 3 j 240° 
ke : h2 
falX] 2 > (ft - OF — 
j=l 
k 
polX] & > (xt - DF, 
k h? Th* 
i ~ > (xt — x)tpt — 2 ee yoy ce ale 
fal Xo |= ot (x3 &)*p} 5) Qs (x3 X)*p* + 740 


where A is the class interval length. 


SOLUTION FOR TYPICAL EXAMPLES 


Example 41.1 To determine the precision of a measuring instrument whose 
systematic error is practically zero, one performs five independent measurements 
whose results are given in Table 25. 

Determine the unbiased estimate for the variance of errors if the value of 
the quantity being measured is (a) known to be 2800 m., (b) unknown. 


TABLE 25 









Experiment No. 


x;y, M. 
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SOLUTION. The value of the quantity being measured is x. Therefore in 
(a) the unbiased estimate of the variance is determined by the formula 


BLY] = : > @& — 3? = “en = 1287.8 sq. m. 


j=l 


If the value of the measured quantity is unknown, its estimate is 


Thus, in (b), the unbiased estimate is 
~ An tl ‘ xe _ 0034 _ 


In a similar way one can solve Problems 41.1 to 41.14 and 41.13 to 41.16. 


Example 41.2 To determine the estimates of the standard deviation of 
the errors given by a measuring instrument whose systematic errors are practically 
zero, one performs five independent experiments whose results are included in 


Table 26. 


TABLE 26 






Experiment No. 


Xy, M. 





To process the data obtained in measurements, the following formulas for 
the unbiased estimates are used: 


= kal > (x; Fe xy: 
=i1 


eee Se 


eg, Ae a ee ee a eee 
6, = dam _ Tet |x,- z| = ko |x; — &|. 


Find &, and é, and determine the variance of these estimates, if the errors obey 


a normal distribution law. 
Filling in Table 27 and summing by columns, we obtain: 











SOLUTION. 
~ AY 
A, = > x; = 490, X= — = 98m., 
J 
ASD pe = a= 16: 6, = kaal A = 1.064, /74 = 457m., 
, x 
cokes 2 — ¢)2 = + = a —_ 
Age 2. xP = 74, G2 _ i) 42 4.48 m. 
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TABLE 27 





The obtained estimates é, and 6, are random variables whose expectation 
is M[é,] = M[a.] = o. To find the variance 6,, we have 


Dla] = MU(6,))] — (Mlasp? = Mig 22 Cs =) _ oa 


= k2M{D[X]}} — 0? = k2q? — o? = (k? — 1)o?. 
For the variance of the random variable 62, we have 
D[é2] = M[(é2)7] = {M[é,]}’, 


where M[(é2)?] = K®M[(S%1 |x: — £/)°. 
Let z; = x; — (1/n) 53-1 x,. Since z, is a linear function of normal random 


variables, it also obeys a normal distribution law with parameters 


M[z] = M)x,— 7 > x | =0 














1< n—| L< 
. — ae yam D _ . 
Diz] Dx: - . 2% J a. a pa . 
i#i 
— 4\2 _ = 
-(° Jo +2 gat loa 
n n n 
Therefore, 


M[(é,)?] = 2M I( > Py ‘ 


=e] 3 at 2S" S allel 
i=1 i=l j7sit+l1 
= kX{nD[z,] + n(n — 1)M[|z,| |z,|], 
where (j # 4) 


Milallell = sree J Hl eal exp {BEA — et) a, 


2noe2V 
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Passing to polar coordinates, we find 


1 n [2 
pt Sree ay 
M[|z:] [2:1] = omeeV1 a : i) R®|sin g| |cos >| 
R*(1 — rsin 29) 
x ea {Tear TY A to 


202 ; 
= [V1 — r? + rarcsin r). 








Here, 
M[z,2;] = T M rs x < 
i#l 








tbh 


“(Fe 


Finally we get 





The ratio between the variances for the random variables ¢, and 6, for different 
n are shown in Table 28. 


TABLE 28 





The solution for this example implies that the estimate of o given by the 
formula 
n — ¥ 2 
Gy = k, ye (x; x) 
n—-1 
has a smaller variance than the result obtained from the formula 
us ~ 
Ga =k > |x; — |; 
g=1 


that is, the estimate ¢, is more efficient. 
Similarly one can solve Problems 41.7, 41.12 and 41.20. 


Example 41.3. From the current production of an automatic boring 
machine, a sample of 200 cylinders is selected. The measured deviations of the 
diameters of these cylinders from the rated value are given in Table 29. 

Determine the estimates for the expectation, variance, asymmetry and the 
excess of these deviations. 
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SOLUTION. To simplify the intermediary calculations, we introduce the 
random variable 


where as “‘false zero”? we take C = 2.5 microns and the class width is h = 5 
microns. 


TABLE 29 


Class No. 1 2 10 





Limits (in from} —20 | —15 +25 
microns) to —15 | —10 +30 





The mean value 











xf (in microns) +27.5 
Size 3 
Frequency 0.035 | 0.055 | 0.075 | 0.120 | 0.245 | 0.205 | 0.130 | 0.085 | 0.035 | 0.015 





Let us determine the estimates of the first four moments of the random 
variable by considering the Sheppard corrections. The calculations are 
summarized in Table 30. 


TABLE 30 





— 0.140 | 0.560 | —2.240 | 8.960 

=2) 81 | —0.165 | 0.495 | — 1.485 | 4.455 

—8 16 | —0.150 | 0.300 | —0.600 | 1.200 

—1 1 | —0.120 } 0.120 | —0.120 | 0.120 
0 0 0 0 0 0 

1 1 0.205 | 0.205 0.205 | 0.205 

8 16 0.260 | 0.520 1.040 } 2.080 

27 81 0.255 | 0.765 2.295 | 6.885 

64 | 256 0.140 |; 0.560 2.240 | 8.960 

125 1 625 0.075 | 0.375 1.875 | 9.375 

















Noe 
ANORRK OW HhORD 
7 
=| 
| 
"| 


» 
| 


= 036; D= 3.21; 
=3.90; E= 42.24, 


& 
| 
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Taking into account the Sheppard corrections, we obtain: 
xX 2ThA+ C= 4,30n, 


BLY] = (8 i GR 5) = 92°95 2, 








[2 
jiglX] © AD — 3AB + 24%) = —113.75 2, 
jialX] © mle es A(4D = 5) + B(64? = 5) = G4 4. in| = 24,215.62 ut, 
SkLX] = ae = ae = 019k: 
Ex[X] = as Gee pac aes 06: 


For the same variables, but without considering the Sheppard corrections, we 
have (see Examples 43.2 and 43.4): 


% 2 4.30n, fia[X] & 25,375.00 u!, 


e2 


Sk[X] % —0.125,  Ex[X] = —0.145. 
D[X] ~ 94.26 v2, 


Problems 41.5, 41.8, 41.18 and 41.19 can be solved in a similar manner. 


PROBLEMS 


41.1 In 12 independent measurements of a base of length 
232.38 m., which were performed with the same instrument, the 
following results were obtained: 232.50, 232.48, 232.15, 232.53, 232.45, 
232.30, 232.48, 232.05, 232.45, 232.60, 232.47 and 232.30 m. Assuming 
that the errors obey a normal distribution and do not contain systematic 
errors, determine the unbiased estimate for the standard deviations. 

41.2 The following are the results of eight independent measure- 
ments performed with an instrument with no systematic error: 369, 
378, 315, 420, 385, 401, 372 and 383 m. Determine the unbiased estimate 
for the variance of the errors in measurements if (a) the length of the base 
that is being measured is known: x = 375 m., (b) the length of the 
measured base is unknown. 

41.3 In processing the data obtained in 15 tests performed with 
a model airplane, the following values for its maximal velocity were 
obtained: 422.2, 418.7, 425.6, 420.3, 425.8, 423.1, 431.5, 428.2, 438.3, 
434.0, 411.3, 417.2, 413.5, 441.3 and 423.0 m./sec. Determine the un- 
biased estimates for the expectation and standard deviation of the 
maximal velocity assumed to obey a normal distribution law. 

41.4 In processing the data of six tests performed with a motor- 
boat, the following values for its maximal velocity were obtained: 
27, 38, 30, 37, 35 and 31 m./sec. Determine the unbiased estimates for 
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the expectation and standard deviation of the maximal velocity, 
assuming that the maximal velocity of the boat obeys a normal 
distribution law. 

41.5 The sensitivity of a television set to video signals is charac- 
terized by data in Table 31. 


TABLE 31 





Find the estimates for the expectation and standard deviation of 
the sensitivity of the set. 

41.6 A number x of independent experiments are performed to 
determine the frequency of an event A. Determine the value of P(A) 
that maximizes the variance of the frequency. 

41.7 A number n of independent measurements of the same 
unknown constant quantity are performed. The errors obey a normal 
distribution law with zero expectation. 

To determine the estimates of the variance by using the experimental 
data, the following formulas are applied: 


(& — *)” —Y, (x; — %)”. 
oan -> “na— 1 
Find the variance of the random variables 6? and 62. 
41.8 The experimental values of a random variable X are divided 
into groups. The average value x* for the jth group and the number of 
elements m, in the jth group are in Table 32. 


TABLE 32 
xj my x} my x} my 
44 ee 47 48 50 l 
45 18 48 33 52 1 
46 120 49 5 58 2 


Find the estimates for the asymmetry coefficient and the excess. 
41.9 A sample, x1, X2,...,X,, selected from a population 1s 
processed by differences in order to determine the estimates for the 
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variance. The formula used for processing the results of the experiment 
is 


n—-1 
62 =k a (%y41 as x)". 
j= 


How large should k be so that &2 is an unbiased estimate of o2 if 


the random variable X is normal? 
41.10 Let x,, x2,..., x, be the outcomes of independent measure- 


ments of an unknown constant. The errors in measurements obey the 
same normal distribution law. The standard deviation is determined 
by the formula 


where 


Determine the value of k for which é is an unbiased estimate of o. 

41.11 Independent measurements of a known constant x are 
X1, Xq,..., X,. The errors obey the same normal distribution law. For 
processing the results of these observations in order to obtain the 
estimates for the standard deviation of errors the following formula is 
used: 


=k > |x; — x. 


How large should k be so that the estimates are unbiased for 
(a) the standard deviation of the errors, (b) the variance of the errors? 

41.12 Independent measurements x,, Xo,..., x, with different 
accuracies of the same unknown constant are made. The estimate of the 
quantity being measured is determined from the formula 


ws Dhar Ayxy, 
Dini A; 


How large should A, be so that the variance of % is minimal if the 
standard deviation of the errors of the jth measurement is o;? 

41.13 A system of two random variables with a norma! distribu- 
tion in the plane is subjected to independent experiments, in which 
the values (x;, ¥,) (A = 1,2,...,”) of these variables are determined. 
The principal dispersion axes are parallel to the coordinate axes. 
Determine the unbiased estimates for the expectation and the standard 
deviations of these variables. 

41.14 Solve Problem 41.13 for the results of the independent 
trials given in Table 33. 

41.15 Under the conditions of Problem 41.13 find the estimates 
for the parameters of the unit dispersion ellipse if before the experiments 
the direction of the principal axes is unknown. 

41.16 Solve Problem 41.15 for the results of 16 independent 


trials given in Table 34. 
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TABLE 33 
Experiment Experiment 
No. No. 
k 
1 
2 
3 
4 
5 
6 
7 
8 












Experi- 





Deviations, 


., X, Selected from a normal population 
is processed to determine the estimates for the standard deviation by 


41.17 Asample x), Xo, .. 


the formula 
é= kf 221 Gs = 9 =m 
n 


where 


How large should & be so that & is an unbiased estimate of the 


standard deviation o. 
41.18 From a table of random numbers, 150 two-digit numbers 


(00 is taken for 100) are selected. These numbers are divided into 
intervals of 10 (Table 35). 


TABLE 35 








1-10 | 11-20 ; 21-30 | 31-40 | 41-50 | 51-60 | 61-70 | 71-80 | 81-90 | 91-100 


16 15 19 13 14 19 





Construct the histogram and the graph of the frequency count. 
Find the estimates for the expectation and variance. 
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41.19 With the aid of a table of random one-digit numbers 250 
sums of five numbers each are formed. The numbers are distributed 
into classes as indicated in Table 36 (if the number coincides with the 
limit of a class, 1/2 is added to the two adjacent classes). Construct the 
histogram and find the estimates for the expectation and variance. 


TABLE 36 





41.20 To determine the value of an unknown constant, n inde- 
pendent measurements are performed. The systematic errors in measure- 
ments are zero and the random errors are normally distributed. The 
following two formulas are used to find the estimated variances: 


~\2 
Pe Dea =) ~2 


] n—1 . 
Pree | ’ 8 gaye (X;41 — x;)?. 


Are 6? and a2 unbiased estimates of the variance? Which of these 
two formulas gives a more accurate value for the variance ? 
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Basic Formulas 


A confidence interval is an interval that with a given confidence level « 
covers a parameter © to be estimated. 

The width of a symmetrical confidence interval 2e is determined by the 
condition 


P{JQ — O| Se) Sy 


where © is the estimate of parameter ©, and the probability P{jO — | < e} 
is determined by the distribution law for 0. 

If x1, X9,..., X, is a sample from a normal population, then the confidence 
level is determined by the formulas: 

(a) for the expectation in the case when a is known, 





. a = P{|% — x| < eh = of), 


for unknown g, 
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where 
n t2 —nj{[2 
r(5)(! th ) 
S,(¢) = 





is Student’s distribution law and 


a ai | 
= é oir ee 
Ae .. ¥)2 
(ase X) 


The values of f, are given in Table 16T,? whose entries are the number of 
degrees of freedom k = n — | and the confidence level «. 
(b) For the standard deviation, 


Vk Vk Viki(L — 4) 
a=Pils-ol <p =P Te <x < Pel = [ PQ) dx, 


Vk/( +) 
where 
k-1p-22/2 
Pix) = ~——_,,,  k=n-1, g=z 
Que - »r(5) g; 


The values of the integral (ei ae P,(x) dy are given in Table 20T. 


The confidence interval for o (7,6, y2é), where the probabilities of its 
lying entirely to the right and entirely to the left of the true value are both 


(1 — «)/2, is determined by the formula 


Pe <n} = P(E > rab = Pia? < 9 
o V2 
- 5 n—1 _ TH« 
=P{x? > rhe 


In order to find y, and y, for a given confidence level a and k = n — J degrees 


of freedom, one may use Table 19T or 18T. 
For an exponential distribution law, the confidence interval for expectation 


(v,X, voX) is given by the expression 














From this vy = 2n/x3, vo = 2n/x?2_,. 
The values for x2 and y?_,; are determined from Table 18T for the 


probabilities 6 and 1 — 4, respectively, and for k = 2n degrees of freedom. 


2 References for the table numbers followed by T are found on pages 471-473. 
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For a sufficiently large sample size (n > 15) the limits of the confidence 
interval for x are calculated approximately by the formulas, 


4 DF=1 X; : 4 Dfa1 %} : 
(V4n — 1 + 2)? (V4n — 1 — e9)? 


where é is the solution of the equation a = O(e,). 

If, from the same population, there are selected N samples each of size n, 
if the event whose probability of realization obeys a Poisson distribution occurs 
m, times (j = 1, 2,..., NM) in the jth sample and the expected value of the 
parameter is given by the formula @ = (}., m,)/N, then for @ > 0 the limits 
of the confidence interval are determined from the relation 


l-e«_s 


P{2NG > xz} = P{2NG < vig he 5 : 





that is, the upper and lower limits are equal to 


Xi-s xb 


IN’ 2N 





respectively, where y?_,; and x3 for a given 8 are chosen from Table I8T, y7_; 
being taken for k = 2 >*_, m, degrees of freedom and x3 for k = 2 (>}_, m; + 1) 
degrees of freedom. 
For & = 0, the lower limit becomes zero and the-upper limit is y3,/2N, 
where x3, is found from Table 18T for k = 2 and level P{2Nd > x2;} = 286. 
For a sufficiently large k (practically greater than 30), the limits of the 
confidence interval are determined approximately by the formulas: 


) (v4 Dien pl £0)” 


(lower limit aN 


Some = 1 ; 
(upper limit) (V4 SP ue 1 + £5) 


where é, is the solution of the equation a = (ep). 

Ifin 1 independent trials a certain event occurs exactly mtimes (0 < m < n), 
the limits p;, Po of the confidence interval, if the probability of occurrence of 
this event is p, are determined from the equations 


LS“ 


Cipil — py)? = 





l—a 


Ci pal — po)? 7? = 5 





M48 tM» 


i] 
Qo 


3 


These equations can be solved approximately with the aid of the incomplete 
£-function. In Table 30T the values of p, and pz are given for different m and 
n and two values of the level «, 0.95 and 0.99. 

For a sufficiently large, one can write approximately 


Pi=p-e, Po=pte, 
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where p = m/n, and «¢ is the solution of the equation 
ci o( svn), 
VB — 8) 


A better approximation is given by the formulas 














he oa. ol 
. _ npts 
2 arcsin Vp, ' ae Eo 
: —?; =2arcsin ,/. + =) 
2 arcsin Vp, n Vn 
one of which underestimates the interval, while the other overestimates it by a 


quantity of the same order of magnitude; «9 is the solution of « = (eo). 


If m = 0, then p, = Oandp, =1— WI —a. 





If m =n, then pp = 1 and p, = V1 — «. 


The confidence interval for the correlation coefficient whose estimate is 
obtained from a normal sample of size m can be expressed approximately in 
terms of auxiliary random variable Z = (1/2) In [(1 + 7)/(1 — F)], whose limits 
(Zy, Zg) Of the confidence interval are determined by the formulas 


Zy = Z — £002, Zp =Z + £902, 


where o, = 1/Wn — 3, e9 is the solution of the equation « = ®(e,),7 = A, + Ag, 
A, = (1/2) In [( + A)/(1 — F)] (the value of this quantity is determined from 
Table 31T) and A, = #/2(m — 1). 

By the values z, and zs, found from Table 31T, or the formula r = tanh z, 
one can find the limits of the confidence interval for r. In the case of large n 
(n > 50) and small 7 (F < 0.5), the limits ry, rg of the confidence interval for 


r are given approximately by 
r ans 
_ =Prt+ Eq0;,5 
lp 


where éq is the solution of the quation « = D(é), 


| — 7? 
Co. = 





SOLUTION FOR TYPICAL EXAMPLES 


Example 42.1 The average distance measured from a reference point in 
four independent trials is 2250 m. The mean error of the measuring instrument 
is E = 40 m. Given the confidence level, 95 per cent, find the confidence interval 
for the quantity measured. 
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SOLUTION. The probability of covering the true value x of the measured 
quantity by the interval (¥ — e, ¥ + e) with random endpoints for a known E 
is determined by the formula 


p £ f 5 Zz? fe 
P{|% — x| < ey ar | xD) Se B daz = 6(=). 
1 —-€é 


where E, = E/Vn is the standard deviation of the random variable 
% = (If) Shas %} ms oe 
Solving the equation O(eVn/E) = 0.95 by means of Table 11T, we find 











that 
eVn 
Eo 9 
2.91 2.91-40 
e= ie E= 5 = 58.2m. 
From this, the limits of the confidence interval will be: 
the upper limit, 2250 m. + 58.2 m. = 2308.2 m.; 


the lower limit, 2250 m. — 58.2 m. = 2191.8 m. 
Similarly one can solve Problems 42.1, 42.6 and 42.13. 


Example 42.2 The standard deviation of an altimeter is o = 15 m. How 
many altimeters should there be on an airplane so that with confidence level 
0.99, the mean error in altitude ¥ is not greater than —30 m., if the errors 
given by the altimeters are normally distributed, and there are no systematic 
errors? 


SOLUTION. The assumptions of the problem can be written as 
P{-30 < ¥ —-X < wm} = 0.99. 


The random variable 
Z=8-8=5 5 y- 
nN OZY 


is a linear function of normally distributed random variables and, hence, it 
also obeys a normal distribution with parameters 


M[Z] = = 


D[Z] = 
Then 





” 


1 co — 
P{—30 < Z <a} = — coe 
{ } Eon a exp 4 xa} dz 


=3 [1 : o(=)| = 0.99, 
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Solving the equation 
0 (20) = 0.98, 


we find from Table 8T that (30V/n)/o = 2.33, 


_ 2.330\. _ 
n= ( a) = 1.36. 


Thus, the number of altimeters on the airplane should be at least two. 
Problems 42.7 and 42.11 can be solved similarly. 





Example 42.3. In contro! tests performed with 16 light bulbs, estimates 
for their expected lifetime and the standard deviation were found: ¥ = 3000 
hours and é = 20 hours. If the lifetime of each bulb is a normal random variable, 
determine (a) the confidence interval for the expectation and the standard 
deviation if the confidence level is 0.9, (b) the probability with which one can 
assert that the absolute value of the error xX will be at most 10 hours and the 
error will be less than two hours. 


SOLUTION. (a) To determine the limits of the confidence interval for the 
expectation, we make use of the equation 


te 
e= | S,(t) dt. 
—te 


In Table 16T fork =n — landa = 0.9, we find that 1, = eVn/é = 1.753, 
hence, it follows that « = 1.7536/V/n = 8.765 hours. 


Therefore, the upper and lower limits of the confidence interval for x are 
3000 + 8.765 = 3008.765 hours and 3000 — 8.765 = 2991.235 hours, re- 
spectively. 

To determine the limits of the confidence interval for ¢, we make use of 
Table 19T. The entries to this table are k = nm — 1 and the confidence level is a. 
For & = 15 and ae = 0.9, we have 


ve = 0.715; yo = 1.437. 


Consequently, for a confidence level 0.9, the values of « compatible with 
the experimental data lie within the limits 0.7756 = 15.50 hours to 1.4376 = 
28.74 hours. 

(b) The probability for the inequality —10 hours < ¥ — x < 10 hours is 
determined by Student’s distribution, 


ty 
a = P{|x — &| < e} = S,(t) dt. 
—te 
From Table 16T for t, = eVnjé = 10V16/20 = 2 and k =n —1 = 15, 
we find that « = 0.93. 
The chi-square distribution permits us to determine the probability for 
the existence of inequality —2 hours < 6 — o < 2 hours; 
VIA ~ 4) 


2 Pipa eee S i Pia ae. 


VEIA +4) 
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For g = e/é = 2/20 = 0.1 and k = n — 1 = 15 degrees of freedom, we 
find from Table 20T that « = 0.41. 
Following this solution one can solve Problems 42.2 to 42.5 and 42.8 to 


42.10. 


Example 42.4 A random variable T obeys an exponential distribution 
law with a probability density f(t) = 1/é exp {—t/Z}. 
The estimate for the parameter 7 is determined by the formula 


1 nr 

=— 20 
Express, in terms of 7, the limits of the confidence interval for ¢ so that 
P{v,f > 7} = P{,f < 7} = (1 — a)/2, if the confidence level a = 0.9 and n 
equals 3, 5, 10, 20, 30, 40. 

SOLUTION. By the assumptions made in this example, 
l—-—« 
2 


Rewriting the inequalities in this expression leads to 


p{ a > == x3} = P(t <2. ris} = 8. 
t 


The random pore U = 2ni/t has a ieee distribution with 2n 
degrees of freedom and, for n > 15, the random variable Z = V2U has an 


approximately normal distribution with 7 = V2n — 1 and o, = 1. Therefore, 
in the first case (for n < 15) we have 


P{v,f > i} = Ply < t} — = 8. 





2n 2n 
Vy => 3? Vo = aan - 
X6 X1-6 


After determining x3 and y?_,; from Table 18T (for 2n degrees of freedom 
and probabilities 6 and 1 — 8), we calculate v, and v2 (see Table 37). 


TABLE 37 





In the second case (nm > 15) according to the formulas at the beginning 
of this solution, we have (see Table 38) 
4n 4n 
eee vy = 
(V4n — 1 + 20)? = Alan a es)? 


Uk iad 
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TABLE 38 


n 20 30 40 














£0 1.65 | 1.65 | 1.65 














vy 0.72 | 0.76 | 0.79 














Ve j 1.53 1.40 |; 1.33 





The quantity <, is determined from Table 8T for the level « = 0.9. 
In Figure 35, there is given the graph representing v, and v, as functions 
of n for the confidence level « = 0.9. 


Example 42.5 Three types of devices (A, B and C) are subjected to 50 
independent trials during a certain time interval; the numbers of failures are 
recorded as in Table 39. Find the limits of the confidence intervals for the 


TABLE 39 








Number of observations 
in which such number of 


Number failures occurred 


of 
failures 





expected number of failures of each type during a selected time interval if the 
confidence level « = 0.9, and the number of failures for each type obeys a 
Poisson distribution law during this interval. 


WWM, 


FIGURE 35 


| 
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SOLUTION. To determine the limits of the confidence interval for the devices 
of type A, we make use of a chi-square distribution. From Table 18T, fork = 24 
degrees of freedom and probability (1 + a)/2 = 0.95, we find y7_, = 13.8; 
for k = 26 and probability 8 = (1 — a)/2 = 0.05, we find x? = 38.9. 
The upper limit a, and the lower limit a, of the confidence interval for a 
devices of type A are equal to 
x? 389 xX? _6 13.8 


a2 = Ny = JoQ ~ 9-389, aq, = 





To determine the limits of the confidence interval for the expected number of 
devices of type B that failed, one also should use the chi-square distribution 
for k = 180 and k = 182 degrees of freedom. Table 18T contains the data 
only for k = 30. Therefore, considering that for a number of degrees of freedom 
greater than 30, a chi-square distribution practically coincides with a normal 
one, we have 


ps (V4 51m; — 1 — &)? — (V4-90 — 1 — 1.64)? 
ee Cpe) a ee 


~ (V4 am, — 1 + 20)? _ (V4-90 — 1 + 1.64)? 
Bay ge 


For devices of type C, >7_,m, = 0 and, therefore, the lower limit of the 
confidence interval is certainly zero. From Table 18T, for A = 2 and probability 
1 — « =0.1, we determine 3, = 4.6 and calculate the value for the upper 
limit: a. = x3,/2N = 4.6/100 = 0.046. 


Example 42.6 Ten items out of thirty tested are defective. Determine the 
limits of the confidence interval for the probability of a defect if the confidence 
level is 0.95 and the number of defective items obeys a binomial distribution. 
Compare the results of the exact and approximate solutions. 


SOLUTION. The exact solution can be obtained directly from Table 30T. 
For x = 10, n — x = 20 and a confidence level equal to 95 per cent, we have 
P, = 0.173, po = 0.528. 

For large np(1 — p), the equations from which we determine the limits 
of the confidence interval for p can be written approximately by using the normal 
distribution: 


2, Pall — ps) vm | exp {Eo | de = a 





d2 








m-(1/2) 

m ] m+ (1/2) (z =F )? l—e 

Crp l= mt | ex {-€ 54") az = . 
z - Pa) a,V 2 -1/2 : 203 2 


From this, 
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where p = m/n = 1/3 and the quantity e, can be determined from Table 8T 
for level a = 0.95, 





xp ol yee 7 
aaa [10 ~ 0.5 + 1.92 ~ 1.96,/=?2P> + 0.96] — 0.180, 


is. i p EE = 
PX ary [10 +05 + 1.92 + 1.96/32? 4 0.96| = 0.529. 


An approximation of the same kind gives the formula 


arcsin V ps ; 2 + (1/2). & 
a a a ak + 
arcsin i} are n ~ 9Vn 
which, when applied, leads to 

P2 & 0.526, Pi & 0.166. 


By a rougher approximation p, and pz can be found if one considers that 
the frequency p is approximately normally distributed about p with variance 
BQ — p)/Vn. 

In this case, 

P2 ~ 
w pte, 
a ses 
where « is the solution of the equation « = O[eWn/Vp(1 — p)]. 
Using Table 8T for a = 0.95, we get 


OV 198, aoe | 2 =0rie0, 
Va — p) 


9-30 
hence, it follows that p, ~ 0.333 — 0.169 = 0.164, p. © 0.333 + 0.169 = 0.502. 


Example 42.7 To study the mechanical properties of steel, 30 independent 
experiments are performed; based on their outcomes, estimates are determined 
for the correlation coefficients 7,, = 0.88 and 7,3, = 0.40 characterizing the 
relation of the endurance level to the resistance and fluidity levels, respectively. 
Determine the limits of the confidence interval for r;2 and r,3 if the confidence 
level is 0.95. 


SOLUTION. For a large sample size 2 and small values of the correlation 
coefficient r, its estimate 7 has a distribution approximately normal with 
expectation M[7] = r and standard deviation o, = (1 — r)|(Vn — 1). Taking 
r & fF, we have: 

rio © 0.88, ri3 ~ 0.40, 
1 — 0.88 


Fy2 CO _—_- = 0.022, 
V'0.29 


_ 1 = 0.40 


F ~ —=— =0.111. 
wre 0.29 
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From Table 8T, for the confidence level a = 0.95, we find «9 = 1.96 
(eg being the solution of the equation « = D(e,)) and the confidence interval: 


(0.84, 0.92) for ryo, 

(0.18, 0.62) for ry. 

The confidence interval obtained can be corrected if we transform 7 so 
that o; is independent of r. This leads to a new random variable 





1, 1+ 
Z= 3 In = ed 
whose distribution is approximately normal even for small x. 
In this case 
1, It+rFr r Pa SO ack F 
MVS GM yep oa ot —+ +t 3m 1) 

and 

Perea: Cee 

OO eed 


Using Table 31T, we determine the confidence interval for the random 
variable Z: 

0.88 (1.014, 1.768) for Fy, 

0.40 (0.053, 0.808) for F,3. 

Using Table 31T, we find the confidence interval: 


(0.77, 0.94) for Fyo, 
(0.05, 0.67) for F,3. 


PROBLEMS 


42.1 Aconstant quantity is measured 25 times with an instrument 
whose systematic error is zero and random errors are normally distri- 
buted with standard deviation E = 10 m. Determine the limits of the 
confidence interval for the values of the quantity being measured if the 
confidence level is 0.99 and ¥ = 100 m. 

42.2 Theresults of measurements not containing systematic errors 
are written in the form of a statistical series (Table 40). The errors obey a 
normal distribution. Determine the estimate of the quantity being 
measured and the limits of the confidence interval for a confidence 


level 0.95. 


TABLE 40 





42. 
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42.3 From the results of 40 measurements of a base of constant 
length, estimates of the length and the standard deviation are found: 
X = 10,400 m. and 6, = 85 m. The errors obey a norma! distribution 
law. Find the probabilities that the confidence intervals with random 
limits (0.999%, 1.001%) and (0.956, 1.056) will cover the parameters x 
and o,, respectively. 

42.4 The results of 11 measurements of a constant quantity are 
included in Table 41. The errors are normally distributed and the 


systematic errors are absent. 


TABLE 41 


Measurement 
No. 


Xj, M. 


AWN 
or 
oko Ron 





Determine (a) the estimates of the length being measured and the 
standard deviation, (b) the probability that the absolute value of the 
error in finding the exact value is less than 2 per cent of X, (c) the 
probability that the absolute value of the error in the standard deviation 


is less than | per cent of 6. 
42.5 Asa result of 100 experiments, it has been established that 


the average time necessary for the production of one item is & = 0.5 sec., 
and that 6, = 1.7 sec. Assuming that the time to produce an item is a 
normal random variable, find the limits of the true values of & and o,, 
for confidence levels 85 per cent and 90 per cent, respectively. 

42.6 The estimate for the velocity of an airplane obtained from 
the results of five trials is 6 = 870.3 m./sec. Find the 95 per cent-confi- 
dence interval if it is known that the dispersion of the velocity obeys a 
normal distribution with standard deviation E, = 2.1 m./sec. 

42.7 The depth of a sea is measured with an instrument whose 
systematic error 1s zero and the random errors are normally distributed 
with standard deviation E = 20 m. How many independent measure- 
ments should be performed to find the depth with an error of at most 
15 m. if the confidence level is 90 per cent? 

42.8 Find for confidence level 0.9 the confidence limits for the 
distance to a reference point X and the standard deviation E£ if in 10 
independent measurements, the results given in Table 42 were obtained, 
and the errors obey a normal distribution. 


TABLE 42 






Experiment 
No. 


25,025 | 24,970 | 24,780 | 25,315 | 24,907 | 24,646 | 24,717 | 25,354] 24,911) 25,374 





Xj, Mm. 
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42.9 Assume that five independent measurements with equal 
accuracy are performed to determine the charge of an electron. The 
experiments give the following results (in absolute electrostatic units): 


4.781-10~7°, 4.792-1071°, 
4.795-1071°, 4.779 -107*°. 
4.769 -1077°, 


Find the estimate for the magnitude of the charge and the confi- 
dence limits of a confidence level of 99 per cent. 

42.10 From the results of 15 independent equally accurate 
measurements, there were derived the following values for the estimate 
of the expected magnitude and the standard deviation of the maximal 
velocity of an airplane: 6 = 424.7 m./sec. and 6, = 8.7 m./sec. 

Determine (a) the confidence limits for the expectation and the 
standard deviation if the confidence level is 0.9, (b) the probabilities 
with which one may assert that the absolute value of the error in & 
and o, does not exceed 2 m./sec. 

42.11 The arithmetic mean of the results of independent measure- 
ments performed with 1 range finders is taken as an estimate of the 
distance to a navigational marker. The measurements contain no 
systematic errors and the random errors are normally distributed with 
standard deviation E = 10 m. How many range finders should there 
be so that the absolute value of the error in determining the distance 
will be at most 15 m. with probability 0.9? 

42.12 It is known that a measuring instrument has no systematic 
errors and the random errors of each measurement obey the same 
normal distribution law. How many measurements should be performed 
to find the estimates for the standard deviation so that with confidence 
level of 70 per cent the absolute value of the error is at most 20 per cent 
of 6? 

42.13 The systematic errors of an instrument are practically zero 
and the random errors are normally distributed with standard deviation 
E = 20m. It is necessary that-the difference between the estimate of the 
measured quantity and its true value is at most 10 m. What is the 
probability with which this condition will be satisfied if the number of 
observations is 3, 5, 10, 25 (construct the graph)? 

42.14 The estimate for a measured quantity is given by the 


formula 
1 nr 
x =r > Xj. 
ne 


The results of individual measurements obey the same normal distri- 
bution law. Find the limits of the confidence interval for level 0.9 with 
the following conditions: (a)¢ = 20m.,n = 3,5, 10, 25;(b)é = 20m., 
n= 3,5; 10, 25. 
42.15 Ten identical devices are tested. The instants when each of 
them failed are recorded. The results of the observations are in Table 43. 
Determine the estimate for the expected time ¢ for nonstop 


42. 


CONFIDENCE LEVELS AND CONFIDENCE INTERVALS 


TABLE 43 


Device No. 


t;, hours 200 | 350 | 600 | 450 | 400 | 400 | 500 | 350 | 450 | 550 





operation of a device and the confidence interval for ¢ if the confidence 
level is 0.9 and the random variable T obeys an exponential distribution. 

42.16 A randomly selected sample of eight devices is subjected to 
reliability tests. The numbers of hours during which the devices 
operate without failures are 100, 170, 400, 250, 520, 680, 1500 and 
1200. Determine the 80 per cent confidence interval for the average 
duration of operation if the reliable operation time obeys an exponential 
distribution law. 

42.17 The probability density for the time between successive 
failures of a radio-electronic device is given by the formula 


fle) = 5 exp {3}, 


where ¢ is the operating time between two successive failures, 7 is the 
expected value of the random variable 7, which is the expected time 
during which the device operates in good condition (called in reliability 
theory “‘the expected lifetime’’). 

For the determination of the estimates of the parameter 7 25 failures 
were observed and the total duration of the reliable time from the start 
of the tests to the last failure turned out to be 5?2, z; = 1600 hours. 

Find the limits of the confidence interval for the parameter f accord- 
ing to the results of these experiments if the confidence level is « = 0.8. 

42.18 To determine the toxic dose, a certain poison is administered 
to 30 rats, eight of which die. Determine the limits of the confidence 
interval for the probability that the given dose will be fatal if the 
confidence level is 0.95 and if the number of fatal outcomes in this 
experiment obeys a binomial distribution law. 

42.19 In 100 independent trials, a certain event A is observed 40 
times. Determine the limits of the confidence interval for the probability 
of occurrence of this event if the confidence levels are 0.95 and 0.99 and 
the number of occurrences of A has a binomial distribution. 

42.20 Ten devices are tested and no failures are observed. 
Determine the limits of the confidence interval in the cases in which 
the confidence levels are 0.8, 0.9 and 0.99 if the failures have a binomial 
distribution. 

42.21 A marksman A scores five hits in 10 shots and B scores 50 
hits in 100 shots; both marksmen fire shots at the same target. Determine 
the limits of the confidence interval for the probabilities that each 
marksman scores a hit in one shot if the confidence level is 0.99 and the 
hits obey a binomial distribution. 

42.22 Six identical devices are tested. During 15 hours of tests 
[2 failures are recorded. Find the limits of the confidence interval for 
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the expected number of failures during 15 hours operation of such a 
device if the confidence level is 0.9 and the tested devices obey a Poisson 
distribution. 

42.23 The number of particles recorded by a counter in the 
Rutherford-Chadwick-Ellis experiment during every one of 2608 inter- 
vals of 7.5 sec. each is given in Table 44. Assuming that the number of 
particles obeys a Poisson distribution, determine the limits of the con- 
fidence interval for the parameter of this distribution, corresponding to 
an interval of 7.5 sec. and to the confidence level 0.9999. 


TABLE 44 


No. of observa- 
tions in which 
this number 
occurred 


No. of observa- 
tions in which 
this number 
occurred 


No. of particles 
reaching the 
counter 


No. of particles 
reaching the 
counter 





42.24 In analyzing the amount of dodder in seeds of clover, it has 
been established that a sample of 100 g. contains no dodder seeds. 
Find the 99 per cent-confidence interval for the average amount of 
dodder in a sample that weighs 100 g. if the amount of dodder obeys a 
Poisson distribution. 

42.25 From the results of 190 experiments performed with items 
made of Type A steel, estimates were found for the correlation co- 
efficients F,5 = 0.55, F13 = 0.30, 7, = 0.37, characterizing the depen- 
dence of the coercive force on the grain and carbon and sulphur com- 
positions, respectively. Determine the limits of the confidence intervals 
for the correlation coefficients if the confidence levels are 0.99 and 0.95 
and if the random variables have a norma! distribution. 

42.26 Inacertain experiment, 25 pairs of values were obtained for 
a system of random variables (XY, Y) with a normal distribution. With 
these experimental data, the parameters of this system were estimated: 
¥ = 10.5, 9 = 74,6, = 2.0,é, = 10.0, 7,,, = 0.62. Find the limits of the 
confidence intervals for the parameters of the system (XY, Y) if the 
confidence level is 0.9. 


43. TESTS OF GOODNESS-OF-FIT 


Basic Notions 


The tests of goodness-of-fit permit estimation of the probability that a 
certain sample does not contradict the assumption made regarding the form of 
the distribution law of a considered random variable. For this purpose, one 
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selects some quantity « representing the discrepancy measure of the statistical 
and theoretical distribution laws, and determines for it a value «, such that 
P(x > x,) = a, where « is a sufficiently small quantity (significance level) 
whose value is determined by the nature of the problem. If the experimental 
value of the discrepancy measure «, is greater than x,, the deviation from the 
theoretical distribution law is considered significant and the assumption re- 
garding the form of the distribution is disproved (the probability of disproving 
a correct assumption with regard to the form of the distribution in this case is 
equal to a). If x, < «,, then the experimental data agree with the hypothesis 
made about the form of the distribution law. 

The test of the hypothesis about the character of the distribution by means 
of goodness-of-fit procedures can be performed in another order: according 
to the value «,, one determines the probability a, = P(x < «,). If a < «, the 
deviations are significant; if «, > «, the deviations are insignificant. The values 
%,, very close to | (very good fit), correspond to an event with very small 
probability of occurrence and indicate that the sample is defective (for example, 
elements with large deviations from the average are eliminated from the initial 
sample without further reason). 

In different tests of goodness-of-fit, different quantities are taken as measures 
of discrepancy between the statistical and theoretical distributions. 

In the chi-square tests (the Pearson tests), the discrepancy measure is the 
quantity y?, whose experimental value x? is given by the formula 


U 2 
mm, — AD; 
gay i pi)? 
i=l np; 


where / is the number of classes into which all experimental values of X are 
divided, 7 is the sample size, m, is the number in the ith class and p, is the 
probability, computed from the theoretical distribution law, that the random 
variable X is in the ith class interval. 

For noo, the distribution of x2, regardless of the distribution of the 
random variable X, tends to a chi-square distribution with k =/—r-—1 
degrees of freedom, where r is the number of parameters, computed according 
to the given sample, of the theoretical distribution law. 

The values of the probabilities P(y? > x2) as functions of x2 and k are given 
in Table 17T. 

To apply the chi-square test in the general case it 1s necessary that the 
sample size m and class numbers m, be sufficiently large (practically, it is con- 
sidered sufficient that n ~ 50-60, m, ~ 5-8). 

The Kolmogorov test of goodness-of-fit is applicable only if the parameters 
of the theoretical] distribution law are not determined by the data of the sample. 
The biggest value D of the absolute value of the difference between the 
statistical and theoretical distribution functions is selected as the discrepancy 
measure of the statistical and theoretical distribution laws. The experimental 
value D, of D is determined by the formula 


D, = max |F(x) — F(x)|, 


where F and F are the statistical and the theoretical distribution functions, 
respectively. 
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As n—>0o, the distribution law for A = VND, regardless of the form of 
the distribution of the random variable X, tends to the Kolmogorov distribu- 
tion. The values of the probabilities «, = P(D > D,) = P(A) = 1 — K(A) are 
included in Table 25ST. 

The Kolmogorov test is also a statistical test of the hypothesis that two 
samples of size n, and n, arise from a single population. In this case, a, = P(A), 
where P(A) is given in Table 2ST, but 





= {2a -max |Fi(x) — FA(x)], 
where F(x) and F,(x) are the statistical distribution functions for the first and 
second samples. 

The form of the theoretical distribution is chosen either on the basis of 
data about the random variables selected or by qualitative analysis of the form 
of the distribution histogram. If the form of the distribution cannot be established 
from general considerations, then it is approximated by a distribution whose 
first few moments are the same as the estimates obtained from the sample. 
For approximating expressions, one can use Pearson’s curves (Gnedenko and 
Khinchin, 1962), which consider the four first moments or the infinite Edge- 
worth series (Gnedenko and Khinchin, 1962). Here, for a small deviation of 
the statistical distribution from the normal, one can retain only the first terms, 
forming a Charlier-A series, 

F(e) = 0.5 + 0.50(2) ~ ¥ gate) + gale), 


where ¢2(z), p3(z) are the second and third derivatives of the normal probability 
density ¢(z); z = (x — M[x])/é, Sk = f,/63 1s the estimate for asymmetry, 
Ex = (fi,/4,) — 3 is the estimate for excess and 6?, 3 and f, are the estimates 
for the second, third and fourth central moments, respectively. 

The values of O(z), ~2(z), pa(z) are given in Tables 8T and 10T. 

The chi-square test also permits us to test hypotheses about the indepen- 
dence of two random variables ¥ and Y. In this case, x2 is determined by the 
formula 
2 > Ay — mi)? 


Xq = 
i=1f=1 mi; 


where fj, is the number of cases in which the values ¥ = x;, Y = y; are observed 
simultaneously, 
= Fiohto; 


47 n 


h;) being the number of cases in which the value X¥ = x, is observed, ho; is the 
total number of cases in which the value Y = y, is observed and / and m are 
the numbers of values assumed by the variables X¥ and Y. 

The number k of degrees of freedom necessary for the calculation of the 
probability P(x? > x?) is given by the formula 


= (J — 1)(m — 1). 
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SOLUTION FOR TYPICAL EXAMPLES 


Example 43.1 A radioactive substance is observed during 2608 equal time 
intervals (each, 7.5 scc.). For each interval the number of particles reaching a 
counter is recorded. The numbers m, of time intervals during which exactly i 
particles reached the counter are given in Table 45: 


TABLE 45 





or more 


| Total n= > m = 2608 


Test, using the chi-square test, the hypothesis that the data agree with the 
Poisson distribution law 






e-%qi 
ae 





Pl, ay= 


The significance level should be taken as 5 per cent. 


SOLUTION. Using the data, we compute the estimate @ of the parameter a 
of the Poisson distribution by the formula 


n 


where 7 = > 9m, = 2608, @ = 3.870. 

For the function P(i, Z@) = p,, we compute, using Table 6T, the theoretical 
probabilities p; that i particles with Poisson distribution reach the counter. 
As a result of interpolation between a = 3 and a = 4, we obtain the values p; 
and mp;, which are given in Table 46. 

We compute the values of x? by performing the calculations in Table 46: 


a= 


10 
~ (mm, — np;)? 

a += = 13.05. 

= 4 mpi 


Since the number of degrees of freedom is k = / — r — 1, where the total 
number of intervals is / = 11 and the number of parameters determined from 
the data is r = | (the parameter a), we have 


kK=11-1-1=9. 


From Table 17T, we find for & = 9 and x? = 13.05 the probability P(y? > 2) 
that the quantity x? will exceed y§. We obtain 


&q => P(,? 2 i) = 0.166. 
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TABLE 46 










0 0.021 2.2 4.84 0.088 
1 0.081 =%2 67.24 0.318 
’) 0.156 =93.8 566.44 1.392 
3 0.201 0.8 0.64 0.001 
4 0.195 23.4 547.56 1.007 
5 0.151 14.2 201.64 0.512 
6 0.097 20.0 400.00 1.581 
7 0.054 ack 3.24 0.023 
8 0.026 928 519.84 7.667 
9 0.011 ie 2.89 0.101 
10 0.007 293 5.29 0.289 
1.000 x2 = 13.049 


Since a, > « = 0.05, the deviations from the Poisson distribution are 
insignificant. 
Similarly one can solve Problems 43.1 to 43.4. 


Example 43.2 A sample of 200 items is selected from the current output 
of a precision automatic lathe. The dimension of each item is measured with a 
precision of | micron. The deviations x, (from the nominal dimension) divided 
into classes and the numbers m, in the classes and their frequencies p* are given 
in Table 47. 


TABLE 47 













































Limits of Limits of 
No. the interval the interval m p* 

i Xi; 10 X44 X; tO Xian 
1 —20 to —15 5 to 10 41 0.205 
2 —15 to —10 10 to 15 26 0.130 
3 —10to -—5 15 to 20 17 0.085 
4 —Sto 0 20 to 25 7 0.035 
5 Oto 5 25 to 30 


Estimate with the aid of the chi-square test the hypothesis that the sample 
distribution obeys a normal distribution law for a significance level a = 5 per 
cent. 


SOLUTION. We determine the values x* of the midpoints of the intervals 
and find the estimates for the expectation and variance by the formulas: 


H 
oO 


* X= x pp? = 430 u, 6? = Mg — X? = 94.26 p?, 


f=1 


10 
Nig. Ne pe == N15 6é= 9.7) wu. 
i=1 
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The computations are summarized in Table 48. 


TABLE 48 


















I 7.5 1.04 
2 2.5 0.28 
3 7.5 1.05 
4 2.5 2.13 
5 2.5 2.24 
6 7.5 0.11 
7 12.5 0.20 
8 17.5 0.01 
9 22.5 0.03 

10 27.5 

11 = 7.09 





The theoretical probabilities p,; that the deviations lie on the intervals 
(X;, X;41) are computed by the formula 


1 1 
i= 5 D(z; +1) ~ 3 O(z;), 


where 2; is the left limit of the ith interval measured with respect to ¥ in & units: 


x; —*X 


4= 
Cc 


Here the smallest z; = z) = 2.06 is replaced by —oo, and the largest z,, = 3.09 


by +00. 

The value of the Laplace function ®(z) is found from Table 8T. The interval 
i = 10, because of its small number, is attached to the interval i = 9. The results 
of the computations are given in Table 48. 

We find that 


9 2 
> (m, — np,) 
ue = AD => 7.09. 


i=1 
The number of degrees of freedom is 
ke he pea 9 = 2 = hSG, 


since, because of the small numbers in the last two classes, the 9th and 10th 
classes are united. 

From Table 17T, for the values y? and k we find «, = P(y? > x2) = 0.313. 
The hypothesis on the normality of the deviations from the nominal dimension 
does not contradict the observations. 

Problems 43.6, 43.7, 43.9, 43.11, 43.13 to 43.21, 43.24 and 43.25 can be 
solved in a similar manner. 


Example 43.3 The results x, of several measurements (rounded-off to 
0.5 mm.) of 1000 items are given in Table 49. 
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TABLE 49 





(m, is the number of measurements giving the result x;.) 

By using the Kolmogorov test of goodness-of-fit, verify that the observa- 
tions agree with the assumption that the variable X obeys a normal distribution 
law with expectation x = 100.25 mm. and standard deviation o = 1 mm., if 
the influence of round-off errors may be neglected. 


SOLUTION. The theoretical distribution function F(x) is defined by the 
formula 


F(x) = 5 + 5 (x — x). 


The statistical distribution function F*(x) can be calculated by the formula 


k eo 
F*(x,) 7 606 > Mm; + 0.5m, . 


t=1 


The computations are performed in Table 50. 


TABLE 50 


|F*(x) — F(x)| 


0.0018 
0.0044 
0.0059 
0.0074 
0.0022 
0.0042 
0.0074 
0.0089 
0.0054 
0.0002 


ODoeaenynanhwn- 


_ 





For each value x,, forming the differences F*(x;) — F(x,) and selecting 
from them the largest in absolute value, according to Table 50 we find 
D, = 0.0089. 

Computing 


\ = Vn D, = V1000-0.0089 = 0.281, 


43. TESTS OF GOODNESS-OF-FIT 307 


we find the value of P(A) from Table 25T: 
a, = P(A) = 1000. 


The value of P(A) is large. Consequently, the deviations are insignificant and 
it can be assumed that the hypothesis that the data obey a normal distribution 
with parameters X = 100.25, co = 1 is valid; however, a large value of « leads 
to doubts about the high quality of the sample. 

Following this solution, one can solve Problems 43.5, 43.8, 43.10, 43.12, 
43,22 and 43.23. 


Example 43.4 According to the data of Example 43.2, select the distribu- 
tion law by using a Charlier-A series, and test by means of the chi-square test 
whether the goodness-of-fit of the data with the resulting distribution law will 
be improved by use of the normal distribution. 

From Example 43.2, we take the estimates of the expectation ¥ and standard 
deviation 6: 

X¥ = 4.30n, é=9.71 yu. 


Moreover, using the data of Tables 47 and 48, we estimate the third central 
moment jig, and the fourth central moment @, of the random variable Y. 


fig = > (x¥ — X)%p¥ = —113.86 yu, 
fig = > (x¥ — &)*p¥ = 25,375 pt. 
1 


The computations are performed in Table 51. 


TABLE 51 





CDorm~7ANUNRWNH— 





—_ 





Total — 113.86 


Furthermore, we compute the estimates for the asymmetry Sk and excess 
Ex by the formulas 


Sk = a =i 1047: 
ee a —~3=-0,1455. 
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Using the first three terms of the distribution function for the Charlier-A series, 


Sk EX 
F(z) = 0.5 + 0.5@(2) — = gal2) + 53 ps2), 


where 
x— xX 





z= > 


we find 
F(z) = 0.5 + 0.5@(z) + 0.0208¢.(z) — 0.0061¢3(z). 


We now compute the values F(z;), and use tables 8T, 10T for the deter- 
mination of the values of (z), ¢.(z), y3(z); here z,; are the coordinates with 
respect to ¥ in & units of the limits of the intervals. The values of z, and the 
subsequent computations of F(z;) are given in Table 52. 


TABLE 52 


~ 





Z tO Zi41 0.5®(z,) to 0.50(z; 41) p2(zi) to polzi+1) 


—o to — 1.99 —0.5 to —0.4761 Oto 0.1630 
—1.99 to —1.47 — 0.4761 to —0.4292 0.1630 to 0.1572 
— 1.47 to —0.96 — 0.4292 to —0.3315 0.1572 to — 0.0197 
— 0.96 to —0.44 — 0.3315 to —0.1700 — 0.0197 to —0.2920 

0.07 —0.1700 to 0.0279 — 0.2920 to — 0.3960 
0.59 0.0279 to 0.2224 — 0.3960 to —0.2185 
1.10 0.2224 to 0.3643 ~0.2185 to 0.0458 
1.62 0.3643 to 0.4474 0.0458 to 0.1745 
2.13 0.4474 to 0.4834 0.1745 to 0.1460 
foe) 0.4834 to 0.5000 0.1460 to 0 


Som ADAMAARWN- 


_ 





i paz) tO pa(Z, +1) F(z) to F(z:41) 


Oto 0.1062 0 to 0.0267 
0.1062 to —0.1670 | 0.0267 to 0.0751 
—0.1670 to —0.5021 | 0.0751 to 0.1712 


—0.5021 to —0.4472 | 0.1712 to 0.3266 
—0.4472 to 0.0834 | 0.3266 to 0.5192 
0.0834 to 0.5245 | 0.5192 to 0.7147 
0.5245 to 0.4290 | 0.7147 to 0.8627 
0.4290 to 0.0654 | 0.8627 to 0.9506 
0.0654 to —0.1351 |} 0.9506 to 0.9872 
—0.135l to 0 0.9872 to 1.0000 


Som ANN hwWNHN— 


—_ 





The theoretical probabilities p,; based on the distribution law defined by 
the Charlier-A series are computed by the formula 


Pi = F(Zi41) — F(2). 


Using these values and noting that n = >}°, m; = 200, we compute (see 
Table 52) 


10 


os aes 2 
a Ne = e565 
t=1 np, 


ap 
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The number of degrees of freedom is k = / — r — 1 = 4 since the number 
of classes is / = 9 (the last two intervals, because of their small number, are 
united into a single interval; the number of parameters determined on the 


basis of the data is r = 4(%, 6, Sk, Ex). From Table 17T, for k = 4 and 
x2 = 5.615, we find that «, = P(y? > x2) = 0.208. 

The hypothesis on the goodness-of-fit of the experimental data with the 
distribution law F(z) specified by a Charlier-A series is not disproved. However, 
there are no reasons to assert that the goodness-of-fit is better than what is 
provided by the normal distribution law mentioned in the assumption of the 
problem. 

In a similar way one can solve Problems 43.26 and 43.27. 


Example 43.5 There are two groups of 60 identical items produced by 
two machines. The data obtained from several measurements of some specific 
dimension x of the items are given in Table 53. 








TABLE 53 
Dimension x Dimension x Dimension x 
Item Item Item 
No. Group Group No. Group Group No. Group Group 
I ll I I I I 

1 72.58 72.50 21 72.50 72.35 41 72.30 72.31 
2 72.35 72.35 22 72.69 72.16 42 72.28 72.46 
3 72.33 72.69 23 72.54 72.51 43 72.51 72.36 
4 72.54 72.60 24 72.48 72.50 44 72.37 72.39 
5 72.24 72.54 25 72.36 72.50 45 72.14 72.30 
6 72.42 72.42 26 72.50 72.48 46 72.42 72.30 
7 72.58 72.68 27 72.43 72.53 47 72.36 72.38 
8 72.47 72.54 28 72.46 72.25 48 72.28 72.55 
9 72.54 72.55 29 72.56 72.48 49 72.20 72.36 
10 72.24 72.33 30 72.48 72.36 50 72.48 72.24 
11 72.38 72.56 31 72.43 72.53 51 72.66 72.23 
12 72.70 72.36 32 72.56 72.23 52 72.64 72.16 
13 72.47 72.36 33 72.34 72.55 53 72.73 72.17 
14 72.49 72.15 34 72.38 72.51 54 72.43 72.37 
15 72.28 72.48 35 72.56 72.25 55 72.28 72.38 
16 72.47 72.46 36 72.32 72.11 56 72.64 72.46 
17 71.95 72.36 37 72.41 72.44 57 72.72 72.12 
18 72.18 72.38 38 72.14 72.51 58 72.35 72.28 
19 72.66 72.40 39 72.29 72.55 59 72.60 72.23 
20 72.35 72.38 40 72.31 72.24 60 72.46 72.38 





Test, by means of the Kolmogorov test, the hypothesis that both samples 
belong to a single population; i.e., that both machines give the same distribution 
of the dimension x at a significance level « = 8 per cent. 


SOLUTION. We divide the items into groups according to the increasing 
dimension x and compute the statistical distribution functions Fy(x) and F(x) 
for each group (see Table 54). 
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TABLE 54 
Number of values 
xX; ss = = a 
x; [————— Fy (xi) F2(xi) Fi(x) — F(x) 
Group Group 
I Il 





We find the largest absolute value D,,,,, of the difference F(x) — F(x): 
Dyn, = 1.667 (see Table 54). 


NyN2 
r = i Dg cnais 
ny + Me 


where in our case 7, = Ng = 6, we obtain A = 0.9130. Using Table 25T, for A, 
we have P(A) = 0.375 = ay. 
The value of «, is large; consequently, the deviations are insignificant and 


the hypothesis that both samples belong to the same main population is not 
contradicted. 


Determining 


Example 43.6 Six-hundred items are measured and for each item the 
dimensions X and Y are checked. The results are given in Table 55, where h,, 
denotes the number of items with dimensions X = x;,, Y = yj. 


TABLE 55 
Xy Under- Within Over- 
estimated: | tolerance | estimated: hio 
jJ=3 limtts: jJ=3 
x; i, 
Underestimated: ¢ = 1! 48 62 
Within tolerance limits: i = 2 402 490 


Overestimated: i = 3 38 48 





hoi 600 
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For X: i= 1 if the dimension is underestimated, i = 2 if the dimension is 
within the tolerance limits, i = 3 if the dimension is overestimated; for Y: 
j = 1,2,3 if the dimension is underestimated, within the tolerance limits, or 
overestimated, respectively. 

Test by using the chi-square test whether the deviations of dimensions 
X and Y from admissible dimensions are independent at a significance level 
a = 5 per cent. 


SOLUTION. We find the estimates m,; of the expected number of observa- 
tions in which ¥ = x,, Y = y, by starting from the hypothesis on the indepen- 
dence of X and Y: 

hioho; 


Mi; = -_os 
4 n 


The values m,; are given in Table 56. 


TABLE 56 





We compute yx? by the formula 


3 3 2 
2 (Ay; — mi) 
x — ee a re 
: 2 2 My; 


The computations are performed in Table 57, in which the values of 
(Ai; — my)?/m,; are given. 


TABLE 57 





We get x2 = 2.519. Then, we determine the number of degrees of freedom 
k=(- 1(m- 1), 


where / is the number of groups according to the dimension X, m is the number 
of groups according to Y, / = 3, m = 3, k = 4. Using Table 17T for k = 4 
and y2 = 2.519, we find «, = P(y? > x2) = 0.672. 
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The value of «, is large; consequently, the hypothesis on the independence 

of the deviations of the dimensions of an item according to the test of X and Y 

against the admissible dimensions is not disproved. 

Problem 43.28 can be solved similarly. 


PROBLEMS 


43.1 In Table 58 are listed the numbers m, of plots of equal area 
(0.25 km.*) of the southern part of London. During the Second World 
War each of the plots was hit by i buzz bombs. Test with the aid of the 
chi-square test that the experimental data agree with the Poisson 


distribution law 
. a‘'e~? 
PGi, a) = 1 





if the significance level is 6 per cent. 


TABLE 58 





43.2 For a thin layer of gold solution, there is recorded the 
number of particles of gold reaching the field of view of a microscope 
during equal time intervals. The results of these observations are given 


in Table 59. 


TABLE 59 


No. of particles, 7 Total 


> m = 517 





nh 


Test with the chi-square test the goodness-of-fit of the Poisson 


distribution: use the 5 per cent significance level. 
43.3 Ten shots are fired from a rifle at each of 100 targets and the 


hits and the misses are recorded. The results appear in Table 60. 

Test, by using the chi-square test, that the probabilities of hitting 
the targets are the same for all shots; in other words, test that the 
outcomes obey a binomial distribution law: use the 10 per cent 


significance level. 
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TABLE 60 





43.4 Seven coins are tossed simultaneously 1536 times and each 
time the number X of heads is recorded. Table 61 lists the number m, 
of cases in which the number of heads is X;. 


TABLE 61 





Using the chi-square test, test the hypothesis that the experimental 
data obey a binomial distribution law. Assume that the probability of 
occurrence of a head is 0.5 for each coin. The significance level should 
be 5 per cent. 

43.5 Each of 100 machines produces a lot of 40 first-grade and 
second-grade items during one shift. Samples of 10 items from each lot 
are selected and for each sample the number of second grade items is 
recorded. The results of the tests are given in Table 62. 


TABLE 62 





6 or more 


0 


The m, denote the numbers of samples with i second-grade items. 
The number of second-grade items produced during a long operation 
period of the plant is 30 per cent (p = 0.30) of all production. 

Test, by using the Kolmogorov test, that the experimental results 
obey the hypergeometric and binomial distribution laws if one uses the 
5 per cent significance level. 

For the quantity i distributed according to a hypergeometric law, 
there obtains the formula 

_ CiCh=t 


Pi,n 3 
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where N is the number of items in the lot, Lis the number of second- 
grade items in the lot and nis the sample size. 
For a binomial distribution, 


Pin = Crp’ — p)*-*. 


43.6 Table 63 contains the deviations from a given dimension 
of the diameters of several cylinders produced by a machine. 


TABLE 63 









OtoS5 | 5to 10 | 10 to 15}15 to 20| 20 to 25 


15 75 100 20 


0.06 0.30 0.40 0.04 


The limits of the interval in microns 









No. ™, in the class 





Frequency p* 


Test, with the chi-square test, the hypothesis that the observations 
obey a normal distribution law if the 5 per cent significance level is used. 

43.7 Suppose that 250 numbers are generated by summing the digits 
of five-digit numbers selected from a table of random numbers. The 
resulting sums are divided into 15 intervals as shown in Table 64. 


TABLE 64 















Interval Interval 














15 to 18 30 to 33 


27.0 
18 to 21 33 to 36 7.5 
21 to 24 36 to 39 1.0 
24 to 27 39 to 42 1.0 
27 to 30 42 to 45 0 


Sums representing multiples of three are equally divided between 
two adjacent intervals. Using the chi-square test, test whether the given 
statistical distribution obeys a normal distribution whose parameters 
are the expectation and variance determined from the data if the 
significance level is 5 per cent. 

43.8 Solve the preceding problem by using the Kolmogorov test. 
Assume (because of the narrowness of the interval in Table 64) that it is 
possible to take all elements in each interval to be the value at the mid- 
point of the interval. To establish the hypothetical normal distribution 
law, consider that any value 0 to 9 for the individual digits of a random 
five-digit number has probability p = 0.1. 

43.9 The digits 0, 1, 2,...,9 among the first 800 decimals of the 
number z occur 74, 92, 83, 79, 80, 73, 77, 75, 76 and 91 times, respec- 
tively. Using the chi-square test, test the hypothesis that these data obey 
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a uniform distribution law if the 10 per cent significance level is used. 
43.10 Solve the preceding problem by using the Kolmogorov 

test, and by assuming that the probability that any digit appears at any 


decimal place is 0.10. 
43.11 From a table of random numbers, 150 two-digit numbers 


(00 is also considered a two-digit number) are selected. The results 
appear in Table 65. 


TABLE 65 














No. m, in | Frequency 
ok 


No. m, in | Frequency 
* the class Pi 


the class Di 





Interval Interval 


























19 0.127 













Oto 9 0.107 50 to 59 
10 to 19 15 0.100 60 to 69 14 0.093 
20 to 29 0.127 70 to 79 0.073 
30 to 39 0.087 80 to 89 0.087 
40 to 49 0.093 90 to 99 0.107 





Using the chi-square test, verify the hypothesis that the observations 

obey a uniform distribution law for a 5 per cent significance level. 

43.12 Solve the preceding problem by applying the Kolmogorov 
test. Assume (because of the narrowness of an interval in Table 65) 
that all the elements in one interval may be taken equal to the midpoint 
of the interval. 

43.13 The readings on the scale of a measuring instrument are 
estimated approximately in fractions of one division. Theoretically, any 
value of the last digit is equally probable, but in some cases certain digits 
are favored over others. In Table 66, 200 readings of the last digit 
between adjacent divisions of the scale are listed. Using the chi-square 
test, establish whether there is a systematic error in readings, i.e., whether 
the observations obey a uniform distribution law if the probability of 
appearance of any digit is p,; = 0.10 and the significance level is 5 per 


cent. 


TABLE 66 


Digit, 7 0) 1 2 3 4 5 6 7 8 9 


m 35 16 15 17 17 19 11 16 30 24 


43.14 The observed daily mean temperature of the air during 320 


days is given in Table 67. 
Establish, with the aid of the chi-square test, which of the two 


distributions, normal or Simpson (triangular), agrees with the data 
better, if the significance level is 3 per cent. 
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TABLE 67 

















xi, °C Xi, POC mM 
—40 to —30 10 to 20 81 
—30 to —20 20 to 30 36 
~20 to —10 30 to 40 20 
—-10to 0 40 to 50 8 






50 to 60 





In Table 68 there are listed the observed time periods neces- 


sary to find and remove the failure of a certain electronic device; these 
periods are expressed in hours with a precision of one minute. 


Interval 
No. ; 
i 


SEDO BW pom 





TABLE 68 


Limits of the No. in Interval | Limits of the No. tn 
interval the class No., the class 
Yi tO Vien i m, 


1/60 to 3/60 


10 
3/60 to 6/60 : : 7 
6/60 to 10/60 : 4 

10/60 to 18/60 2 

18/60 to 35/60 1 

35/60 to 1.0 more than 30 0 


1.0 to 1.8 


Using the chi-square test, test that the data obey a logarithmically 
normal] distribution in which x = log y obeys a normal distribution 
if the significance level is 5 per cent. 

43.16 The data of the Vorontsov-Vel’yaminov catalog, the 
distribution of distances to planetary nebulae, are exhibited in Table 69, 
where X; is the distance (in kiloparsecs) and m, the number of cases 
(number in the class). 


TABLE 69 








Using the chi-square test, test the hypothesis that the data agree 
with the distribution law whose distribution function F(|x|) has the form 








rind =} [9254) + (24) 
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where x and o are the expectation and the standard deviation of the 
random variable X obeying a normal distribution law and are related to 
the expectation M[| X |] and the second moment mz, of the absolute |X| 
by the formulas: 














Here, v is the root of the equation 


2[o%) + 0.500) _ MU/L ¥ 1] 


VI + v? VMs 


where g(v) and ®() are determined from tables 9T and 8T. The 


significance level is 5 per cent. 
43.17 In Table 70 the results of several measurements ofa quantity 


X are given. 


TABLE 70 

















Limits of Limits of Limits of 























the interval the interval the interval m 
x x 
75 to 77 85 to 87 8 
77 to 79 87 to 89 3 
79 to 81 89 to 91 1 
81 to 83 91 to 93 
83 to 85 93 to 95 





Using the chi-square test, test that the data agree with the normal 
distribution law, and with the convolution of the normal and uniform 
distributions whose parameters are to be determined from the results of 
measurements. 

Remember that for the random variable ¥ = Y + Z, where Y 
and Z are independent and Y obeys a normal distribution law with 
zero expectation and variance o? and Z obeys a uniform distribution 
law in the interval («, 8), the probability density (x) is given by the 


expression 
40) ag tg (=) SA) 


To determine the estimates of the parameters o, a, 8, appearing 
in the formula for ¥(x), it is necessary to derive, from the data, the 


~ 


estimates for the expectation ¥ and the second and fourth central 
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moments fz and fg, after which the estimates of o, a, B are given by the 
equations: 


(B ;=- a)? :) ~2 5 a 
ages Sap gee G 
Bra 

= 

43.18 For 602 samples, the distance r (in microns) of the center of 

gravity of an item to the axis of its exterior cylindrical surface is 

measured with the aid of a control instrument. The results of the 

measurements appear in Table 71. 





TABLE 71 
Intervals Intervals 
of values of values 
ry at 

0 to 16 80 to 96 
16 to 32 96 to 112 
32 to 48 112 to 128 
48 to 64 128 to 144 


64 to 80 144 to 160 





Using the chi-square test, verify that the data obey a Rayleigh 
distribution 


1 
fir) = sare; 


the estimate of the parameter a should be determined in terms of the 
estimate f for the expectation by the formula 


M[r] = af 


Use the 5 per cent significance level. 
43.19 Table 72 gives the results of 228 measurements of the 
sensitivity X of a television set (in microvolts). 


TABLE 72 
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Using the chi-square test, determine the better fit between the 
normal and the Maxwell distribution whose probability density is 
defined by the formula 


2 2 
IO) = 2 = 2 exp {-S 70"), Dae 
Assume the expectation M[X] of X and a are related by the formula 
M[X] = xo + 1.596a. For simplicity, select as x, the smallest observed 
value of X. 
43.20 A lot of 200 light bulbs is tested for lifetime T (in hours) 
and gives results as in Table 73. 


TABLE 73 


















































Limits of No. in Limits of No. in 

No. the class the class the class the class 
i 0,10 trad 1,10 tad my 
1 Oto 300 1800 to 2100 9 
2 300 to 600 2100 to 2400 7 
3 600 to 900 2400 to 2700 5 
4 900 to 1200 2700 to 3000 3 
5 1200 to 1500 3000 to 3300 2 
6 1500 to 1800 more than 3300 0 





Using the chi-square test, test that the data obey an exponential 
distribution law whose probability density is expressed by the formula 


flty = ae: 


The significance level should be taken equal to 5 per cent. 

Consider the fact that the parameter 4 of the exponential distri- 
bution law is related to the expectation of the random variable T by 
the formula 

1 
‘= My 

43.21 A lot of 1000 electronic tubes is tested for lifetime. Table 74 
gives the lifetime intervals (t,; t,.1) before breakdowns occur and the 
corresponding sizes m, of the classes; t, are expressed in hours. 

Using the chi-square test, verify the hypothesis that the experi- 
mental data agree with the Weibull distribution law. The distribution 
function F(t) for this law is given by the formula 


FOS keep {-(73)"}. 


fa r(- + 1); 
m 


where 


I(x) is the [’-function. 
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TABLE 74 


No. of the 
interval i 


Limits of the 
interval 
f, tO fied 


No. in the class 
m 


No. of the 11 


interval i 


Ls oe 700 to | 800 to more than 
800 900 1000 
t, tO tad 


No. in the class 
on 32 2 





The parameters 7 (the expected value of 7) and m should be com- 
puted from the data. Take into account that m is related to the standard 


deviation o by the formula 


where 

r(= " 1) 

a, See Se 

r(— x 1) 
m 


Vm = a/é is the coefficient of variation. 
In Table 32T, there are given the values of b,, and v,, as functions 
of m. Knowing v,,, we can find n and 6,, from this table. The following 


is a section of this table (Table 75). 


On = 


TABLE 75 





43.22 The position of a point M in the plane is defined by rec- 
tangular coordinates ¥ and Y. An experiment consists of measuring 
the angle » made by the radius-vector of a point M with the y-axis 
(Figure 36). The results of 1000 measurements of  rounded-off to the 
nearest multiple of 15 degrees and the numbers m, of appearances of a 
given value 9, are shown in Table 76. 
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FIGURE 36 





TABLE 76 









9, degrees 





gi, degrees 


— 82.5 67 
—67.5 66 
— 52.5 111 
—37.5 


If X and Y are independent normal variables with zero expectations 
and variances equal to o? and (1/4)c?, respectively, then z = tang 
must obey the Cauchy distribution (the arctan law), 


2 
f(z) = aa ea 


Assuming that there are no errors in the measurements of p and that 
the round-off errors may be discounted, test, by using the Kolmogorov 
test, the validity of the preceding assumptions made about X and Y if 
the significance level is 5 per cent. 

43.23, To check the precision of a special pendulum clock at 
random times, one records the angles made by the axis of the pendulum 
and the vertical. The amplitude of oscillation is constant and equal to 
«= 15°. 

The results of 1000 such measurements, rounded-off to the nearest 
multiple of 3°, appear in Table 77. 


TABLE 77 






















m—no. of m—no. of 

a measured neeeeS measured Gee enGEs 
in degrees in degrees of ei 
— 13.5 714 
—10.5 76 
—7.5 81 
—4,5 100 


—1.5 
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Assuming that the round-off errors may be discounted, test, using 
the Kolmogorov test, the hypothesis that the data agree with the arcsine 
distribution law if the significance level is 5 per cent. 

43.24 To check the stability of a certain machine, the following 
test is conducted every hour: a sample of 20 items selected at random 
is measured and, using the results of the measurements, one computes in 
the ith sample the unbiased estimate of the variance 6?. The values of 
a? for 47 such samples are given in Table 78. 


TABLE 78 





_ 
CVONANAWN— 





Using the chi-square test, test at a 5 per cent significance level the 
hypothesis of proportionality of the variances; that is, test the assump- 
tion that there is no disorder, which means that the dispersion varies 
with the measured dimension of an item. Take into account the fact that 
if this hypothesis is valid, the quantity 


n, — 1)6? 
gee eae 


obeys approximately a chi-square distribution law with (n, — 1) 
degrees of freedom, where 6? is the unbiased estimate for the variance 
o* of the entire main population and can be computed by the formula 


a2 = Die a(n, Ti 1) 
N-—m 


where n; = m = 20 is the number of items in each sample, m = 47 is 
the number of samples and N = 57_, n, = 940 is the total number of 
items in all samples. 

43.25. There are m = 40 samples of n = 20 items each, and for 
the ith group there is given as an estimate for the expectation X,, a 
randomly selected value x,;, from the ith sample x,; (for example, the 
first in each sample), and for the variance, the unbiased estimate of the 
variance 6? for the dimension x of an item. The values of %,, x,,, 6? for 
the 40 samples appear in Table 79. 
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TABLE 79 








Ral 
a 

Rall 
Q 
“Nn 


OBCO~AYAARWNS 






Using the Kolmogorov test, verify for the 10 per cent significance 
level the hypothesis that the normal distribution obtains for the 
dimension x. 

Note that in this case (for n # 4) 


_ Vn — 2. 
"4 Vn = 1 = 7 
where 


obey a Student’s distribution law with k = n — 2 = 18 degrees of free- 
dom, where x,; is a randomly selected value from the ith sample (in our 
case Xj). 

43.26 The results of 300 measurements of some quantity x are 
included in Table 80. 





TABLE 80 

Limits of Limits of Limits of 
the interval m the interval the interval 
xX XY x 
50 to 60 1 100 to 110 140 to 150 
60 to 70 2 110 to 120 150 to 160 
70 to 80 9 120 to 130 160 to 170 
80 to 90 23 130 to 140 170 to 180 
90 to 100 33 
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Using the chi-square test, test that the data agree with the normal 
distribution whose parameter estimates should be computed from the 
experimental data. Smooth the data with the aid of a distribution 
specified by a Charlier-A series, and, using the chi-square test, verify 


that the data agree with the obtained distribution. 


43.27 The measurements of light velocity c in the Michelson- 
Pease-Pearson experiment gave the results shown in Table 81. For 


brevity, the first three digits of c, (in km./sec.) are omitted (299 000). 





TABLE 81 
Limits of Limits of Limits of Limits of 
the interval the interval the interval the interval m 
Ci cr Ci Cc 
735 to 740 755 to 760 775 to 780 795 to 800 5 
740 to 745 760 to 765 780 to 785 800 to 805 2 
745 to 750 765 to 770 785 to 790 805 to 810 3 
750 to 755 790 to 795 | 810 to 815 4 





The following estimates for the expected value é and the standard 
deviation & were obtained from the data: 


€ = 299733.85 km./sec., & = 14.7 km./sec. 
The chi-square test of the hypothesis that the data agree with a 


normal distribution law with parameters € and 6 gives the value 
x? = x7q = 18.52; the number of degrees of freedom in this case is 
ky = 9and P(x? > x77) = 0.018; small intervals are united. The hypo- 
thesis should be rejected. 

Smooth the observations with the distribution law specified by a 
Charlier-A series and test, with the chi-square test, that the experi- 
mental data obey the resulting distribution law. 

43.28 Two lots, each containing 100 items, are measured. 
The number of items h,;,; with normal, underestimated and over- 


estimated dimensions are exhibited in Table 82. 


TABLE 82 





Dimension j 


Results of measurements j 





Lot no.| 1 (underestimated| 2 (normal 3 (overestimated h 
i dimension) dimension) dimension) bs 
: 1 25 50 25 100 
2 Be 41 7 100 


hoy 77 91 32 200 
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Using the chi-square test, determine whether the number of a lot 
and the character of the dimensions of the items are independent at a 
5 per cent significance level. 
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Basic Formulas 


The method of least squares is applied for finding estimates of parameters 
appearing in a functional dependence between variables whose values are 
experimentally determined. 

If the experiment gives n + 1 pairs of values (x,, y,), where x, are the values 
of the argument and y, are the values of the function, then the parameters of 
the approximating function F(x) are selected to minimize the sum 


S = 2 Ly: i F(x)]?. 
If the approximating function is a polynomial, that is, 


F(x) = On(x) = do + ax t++++ a_x™ (mM <n), 


then the estimates of its coefficients @,, are determined from a system of m + 1 
normal equations 


™m 


Py Sh 9% = 549 + S410, +-°° + Seamdm = Ve Ges 01 25 25.5471); 
where 
Sip = > xf (k = 0, Li 23 , 2m), 
1=0 
i. =>, pet C0, Ny 2 2) 
i=0 


If the values x, are given without errors and the values y, are independent 
and equally accurate, the estimate for the variance 6? of y, is given by the formula 
1 


= Simin > 


e = 
n—m 





where Sj, 18 the value of S, computed under the assumption that the co- 
efficients of the polynomial F(x) = Q,,(x) are replaced by their estimates that 
are determined from the system of normal equations. 

If y, are normally distributed, then the method given is best for finding the 
approximating function F(x). 
_ The estimates 6,, of the variances of the coefficients d;, and the covariances 
Ka,,a, are given by the formulas 


~ = ~2 = 2 
Gq, = My 6 5 Ko, 0; = M,, 6 + 


where M,, = A,,/A, A = |d,,;| is the determinant of the system of normal 
equations of the (m + 1)st order, 


diy = Shes Gi, k = 90, Le 2o505 5 


A,, is the cofactor of d,; in the determinant A. 
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In solving the system of normal equations by the elimination method, the 
quantities M,,; may also be obtained without replacing the v, by their numerical 
values. The linear combination of the v, used to represent d, will have as the 
coefficient of v,; the desired number M,, ,. 

In the particular case of a linear dependence m = 1, we have: 


y= 4 + AX, 








Pe SqVQ — S101 iw — $1Vpo + SoVz 
ao = a eaneh ii ay SS 
SoSo ey ST SoSq = Sy 
xD Se Sroin =2 So Sthin 
0 3 Ga, 2 
So9Sq9 — Stn — 1 SoSo9 — Sin — 1 
i Sy Synin 


In the case in which the measurements are not equally accurate, that is, 
y;, have different variances o?, all the previous formulas remain valid if S, s, 
and v, are replaced by 


a > pixt (k = 0,1, 2,..., 2m), 


Uy = > ivixt (k= 0,15 232.025) 


A? is a coefficient of proportionality. 
If the ‘‘ weights” p, are known, the estimates of the variances of individual 
measurements y, are computed by the formula 


If y; is obtained by averaging n, equally accurate results, then the “* weight” 
of the measurement y, is proportional to n,. One may take p? = n;. All the 
formulas remain unchanged except the one for 67; in this case, 


Stain 
(2 — mm — 1), 


The confidence intervals for the coefficients a, for any given confidence 
level have the form 


ef = 


ay, —_ Ga, < ay < ay, + Va,» 


where y is determined from Table 16T for Student’s distribution for the values 
of « and k = n — m degrees of freedom. 
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In the case of equally accurate measurements, the confidence interval for 
the standard deviation o and the confidence level « are determined from the 
inequalities 

YE <o < yoo, 
where y, and yz are found from Table 19T for a chi-square distribution with 
entry value a and & degrees of freedom. For the same purpose, one can use 
Table 18T; in this case, 


pie jo 
n= > YQ = , 
: x? x2 


where x7 and yg are determined from the equations 


Lo ies 
PX? <x) => POP > xD = 




















for k = n — m degrees of freedom. 

The confidence limits form a strip containing the graph of the unknown 
correct dependence y = F(x) with a given confidence level a; they are determined 
by the inequalities 

On(Xi) — ¥Fy(%)) < VO) < Qn(%i) + yey(r1), 
where 62(x,) is the estimate for the variance of y defined by the dependence 
y = Q,(x) (it depends on the random variables represented by the estimates 
of a,). 

In the general case, the computation of 62(x) is difficult because it requires 
the knowledge of all the covariances k,, .,. For a linear dependence (m = 1), 

62x) = G2, + 62x? + 2k aa, X- 


The value of y is determined from Table 16T for Student’s distribution for 
the entry a and k = n — m degrees of freedom. 

In the case of equidistant values x, of the argument, the computation of the 
approximating polynomial can be simplified by using the representation 


On(X) = 3, BePrial Xs 


where P,, ,(x;) are the orthogonal Chebyshev polynomials: 


xX’(x’ — 1)--- 0’ —-J t+ 1 


\y— —1]VYC7C7.. > 
Pral) =D (—WChChas GG) =F FD 


X—- xX x = 
x’ = min | h — “max min | 


h n 
Xmax> Xmin are the maximal and minimal values of x,, 


C . , . ' 
by, = —, Ck = > VP rxn(Xi)s Si = > Pi, n(xi). 
Si i=0 i=0 


The estimates for the variances of the coefficients b, are determined by the 
formula 
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The values of the Chebyshev polynomials multiplied by P, ,(0) for 
k =1to5,n = Sto 20, x’ = 0,1,..., are given in Table 30T. 

If the coefficients b, are computed from Table 30T, then for the computa- 
tion of the polynomials P,, ,(x’) in the formula for Q,,(x) it is also necessary to 
consider the coefficient P,,,(0) and to choose the ordinates of these polynomials 
from the same tables or to multiply the value of the polynomial, obtained 
according to the preceding formula, by P, ,(0). 

In some cases, the approximating function is not a polynomial, but can be 
reduced to a polynomial by a change of variables. Examples of such change 
are given in Table 83. 


TABLE 83 











a Initial function The fe snes es Change of variables 
1 | y = Ae*™* Z=4 + ax z=Iny;a,o=InA;aq, =k 
2 )y= Bx Z= 4+ au z= logy; u = logx 
3 ysa+S Y=a4+ au u=t 
a 1 
4|ysa+% y= ay + aw “= 
_ 7\2 
5 y= Aexp{-S— 2") Z= d) + ax + aox? z= logy; 
fog 
loge, 
a) = log A Ao? 
a loge 
a= ce 
oO 
loge , 
ag > —- a2 a 
1 
6 yoatt+Sr Y= ao + au ae 
+ agu?+--- 
7 |) y=aot ax y=Hat+ au u= x? 
+ aax” +--- + dou? 
8 | y = aox7™ + ayx" Z=a+ au Z= yx™, uw = xr 


If y is a function of several arguments z,, then to obtain the linear approxi- 
mating function 
Y = AZo + OZ, Hes + OZ m 


corresponding to the values y,; and z,; in (7 + 1) experiments, it is necessary 
to find the solutions &, of the system of normal equations 


Syo%q + Syi%y +++ + Simm = Px (k = 0,1,2,..., m), 
where 


Seg =D 2ei2s (k,j = 0, L, Zac as 


By = > ViZet (oO, 2. aoc5 M1): 
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If the values z,; are known without error and the measurements of y, are 
equally accurate, the estimates of the variances of a, are determined by the 
formula 
oe = Ny; 
where 6? = S,i,/(n — m) and N,,,, is the ratio of the cofactor of a diagonal 
element of the determinant (of the system of normal equations) to the value of 
the determinant itself. In solving the system without using the determinant, 
Nx, Will be the solutions of this system if we replace all 8, by 1 and the other 8, 
by zeros. 

The role of z, can be played by any functions f(x) of some argument x. 
For example, if the function y, defined in the interval (0, 27), is approximated 
by the trigonometric polynomial 


y=Ao + > (A, cos kx + py, sin kx), 
k=1 


then for equidistant values x; the estimates for the coefficients A, and ps, are 
determined by the Bessel formulas: 








nr 2 nr 
\y = a 7 2, he = FZ D, 71.008 kes 
Se > sin k. (k = 1,2 ) 
‘ae le Ji xi = 1,4,...,M). 


For a complex functional dependence and a sufficiently small range of 
variation of the arguments z,, the computations are simplified if the function 
is expanded in a power Series of deviations of arguments from their approximate 
values (for example, from their mean). 

If there are errors in x; and y, too, and these variables obey a normal 
distribution, then, in the case of linear dependence 


YHA + aX, 


the estimate d, is the root of the quadratic equation 


2 
[s? — (@ + Ds_] 2% — [R - (2 + Ya] ; 
a + as a, =0 
: Sify — (n + 1)v, : Te ° 


and the estimate d is given by the formula 
fe no aS, 
a, = ————— 
: n+ 1 
where o2, o? are, respectively, the variances of the x, and the y,, 
n k nr ke nr 
Se = 2 OM, t= 2 (kK = 1,2), Va = Poe 


i=0 


Of the two roots of the quadratic equation, we select the one that better 
fits the conditions of the problem. 
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SOLUTIONS FOR TYPICAL EXAMPLES 


Example 44.1 In studying the influence of temperature ¢ on the motion w 


of a chronometer, the following results were obtained (Table 84). 


™, 


AUuUhwnNn oO 





TABLE 84 





If 
@ = Ay + a(t — 15) + a(t — 15)”, 


holds, where @ are the computed values of w, determine the estimates for the 
coefficients a, and the estimates for the standard deviations, o of an individual 
measurement and 6,, of the coefficients a,. Establish the confidence intervals 
for a, and for the standard deviation o, characterizing the precision of an 
individual measurement for a confidence level « = 0.90. 


SOLUTION. We determine the normal equations for the coefficients a, 


and M,,,.. To decrease the sizes of the coefficients of the normal equations, we 
introduce the variable 


5 
~ TS 


and seek the approximating function 
Y= ay + Qyx + agx?. 


We then determine the coefficients of the normal equations s, and v,, as 
in the computations in Table 85. 


TABLE 85 
wx? 
— 0.667 0.4449 — 0.2967 0.1979 2.60 1.1567 
— 0.360 0.1296 — 0.0467 0.0168 2.01 0.2605 
0.067 0.0045 0.0003 0.0000 1.34 0.0060 
0.307 0.0942 0.0289 0.0089 1.08 0.1017 
0.627 0.3931 0.2465 0.1546 0.94 0.3695 
0.987 0.9742 0.9615 0.9490 1.06 1.0327 
1.293 1.6718 2.1617 2.7949 1.25 2.0898 
$1 = 2.254 | s.=3.7123 | s3=3.0555 | s4= 4.1221 v1 =1.2154 | vg = 5.0169 





We obtain: 
Sua 7s 5S; = 2.254, So = 3.712; Sg = 3.056; S_ = 4.122; 
vg = 10.28; v1 = 1.215; Do = 5.017. 
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The system of normal equations becomes 
Taq + 2.2544, + 3.7124, = vo, 
2.254 + 3.7124, + 3.0564, = v,, 
3.7124 + 3.0564; + 4.12245 = vg. 


Solving this system by elimination and without substituting the numerical 
values for v,, we obtain: 


dg = 0.2869v, + 0.0986v, — 0.3314vz, 
4, = 0.0986v, + 0.7248v, — 0.6260v., 
Gz = —0.3314v, — 0.62600, + 1.0051v.. 
Substituting the values of v,, we find: 
Go = 1.404; a, = — 1.246; G, = 0.8741. 
M,,,, are the coefficients of v, in each equation for 4G;,; that is, 
Moo = 0.2869; M,, = 0.7248; Mo. = 1.0051. 


We compute the value S,,;, necessary for finding the estimates of the vari- 
ance of an individual y; and the variances of the coefficients d,,; the compu- 


tations are in Table 86. 


TABLE 86 


i ag + ax azx? a, E e? 


2.2352 0.3889 2.624 — 0.024 | 0.000576 
1.8527 0.1133 1.966 0.044 | 0.001936 
1.3207 0.0039 1.325 0.015 | 0.000225 
1.0217 0.0823 1.104 —0.024 | 0.000576 
0.6230 0.3436 0.967 —0.027 | 0.000729 
0.1745 0.8515 1.026 0.034 | 0.001156 
— 0.2067 1.4613 1.255 —0.005 | 0.000025 


NAARWNROS 


Smin = 0.005223 





We obtain Sin = 0.005223. Furthermore, we find 


52 = 5mm _ 9.001306; ¢ = 0.03614: 


6 —2 
62, = Mo,0* = 0.0003746; 62, = 0.0009464; 6, = 0.001312; 
Gy, = 0.01936; Gq, = 0.03076; Gq’, = 0.03623. 
Returning to the argument ¢, we obtain 
@ = Gy + 4,(t — 15) + 4,(t — 15), 
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where 
Gy) = 4,=1404; a = a = —0.08306; 
a, — £2 = 0.003885 
a= 5a 


and the corresponding estimates for the standard deviations 6,, : 


= Gy, = 0.01936; &, = 2 = 0.001291: 





Fa, 


Qr 


Se, = Gea = 0.0001610. 





We find the confidence intervals for the coefficients a, for a confidence 
level « = 0.90. Using Table 16T, for the values of « and k=n—m=4 
degrees of freedom, we find 

y = 2.132. 


The confidence intervals for a,: 


Oy Peng: Ope = Be yea 5 
become 
1.363 < do < 1.446, 


0.08031 < a, < 0.08581, 
0.003542 < az < 0.004228. 


We find the confidence interval for the standard deviation o, characterizing 
the precision of an individual measurement: 


¥1¢ <o< 26, 


where y; and yz are determined from Table 19T for k = 4, a = 0.90. We have 
y¥1 = 0.649; y, = 2.37, hence, 


0.02345 < o < 0.08565. 
Similarly one can solve Problems 44.1 to 44.3, 44.5, 44.9, 44.10 and 44.13. 


Example 44.2 The results of several equally accurate measurements of a 
quantity y, known to be a function of x, are given in Table 87. 


TABLE 87 
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Select a fifth-degree polynomial that approximates the dependence of y 
on x in the interval [0, 2.7]. Use (the orthogonal) Chebyshev polynomials. 
Estimate the precision of each individual measurement as characterized by the 
standard deviation o, and find the estimates of the standard deviations of the 
coefficients b, for the Chebyshev polynomials P,, ,(x). 


SOLUTION. We make the change of variable z = x/0.3 in order to make 
the increase of the argument unity. We compute the quantities S,, c,, by, 
(k = 0,1,..., 5) according to the formulas given in the introduction to this 
section. The tabulated values of the Chebyshev polynomials are taken from 30T. 
The computations are listed in Table 88. 


TABLE 88 






N 








WOMAANMNARWNK © 
Pe eet fk ek tek ek et ee 


y 
I 
° 





The computations, performed on a (keyboard) desk calculator with accumu- 
lation of the results, give: 


Sp = 10, S, = 330, So. = 132, 
S3 = 8580, S, = 2860, Ss = 780, 
Co = —90.530, c, = 66.802, Co = —7.497, 


Cs = — 14.659, cg = 14.515, Cs = — 1.627. 
For the estimates of the coefficients b, we get: 


~ 


by = — 90.530, 5, = 0.20243, = —0.05680, 
5, = —0.00486, 5, = 0.00508, 5; = —0.00209. 
Recall that if one uses the tabulated values of the Chebyshev polynomials, 
the formula for the required fifth-degree polynomial has the form 
y= boPo.o(z) a by Py (2) a bs Po,0(z) oh bs Pa,o(z) ea by P, o(z) ae bsPs.o(Z). 


However, if one uses the analytic formulas for the calculation of the Chebyshev 
polynomials, then the coefficients b;, should be replaced by b, =0,P;,.,(0), where 
P,,,,(0) is the tabulated value of P,,,(z) for z = 0. 

We compute the estimate 6?: 


= Simin < ~ 
Sag ea Ora 


oz 
ine} 
| 
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where we use the tabulated values of the Chebyshev polynomials from Table 
88 for finding the values ,. The computation of Sj, is indicated in Table 89. 





TABLE 89 

x rat & e? 
0.0 0 — 0.010 0.000100 
0.3 1 0.009 0.000081 
0.6 2 — 0.003 0.000009 
0.9 3 — 0.013 0.000169 
1.2 4 0.000 0.000000 
1.5 5 0.020 0.000400 
1.8 6 0.002 0.000004 
2.1 7 — 0.032 0.001024 
2.4 8 0.026 0.000676 
2.7 9 — 0.006 0.000036 

Smin = 0.002499 

We obtain: 





Soin = 0.002499, @= ei Smin_ _ 9.92503. 
yi—-m 


Next, according to the formula 


wo 
k V Sy 
&,, = 0.007917; Gy, = 0.001378; 6, = 0.002179; 
G, = 0.0002702 ; &, = 0.0004680; 6, = 0.0008947. 


Gy 


we find 


Problems 44.4, 44.6 and 44.12 can be solved by following this solution. 


Example 44.3. The readings of an aneroid barometer A and a mercury 
barometer B for different temperatures ¢ are given in Table 90. 


TABLE 90 





If the dependence of B on tand A has the form 
B=A+a,.+ at + «(760 — A), 
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find estimates of the coefficients a,, construct the confidence intervals for the 
coefficients «, and for the standard deviation o of the errors in measuring B 
for a confidence level « = 0.90. 


SOLUTION. Let us use the notations z7 = 1, z;=4t, Zz. = 760 — A, 
y = B — A. Then, the required formula becomes 


Y = AZ + a4Z, + MZ. 


The initial data for these notations are represented in Table 91. 


TABLE 91 






™ 
N 
° 
N 
na 
N 
X) 
~ 











ea 
—_—— 

ONAN WH WHE 
| 


CON wWAWWNO 
| | 
VAWALWAWAR 
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— ee eee 
TONNYRPAYANDNS 
UW wWUAAUNWHE BROS 


OW OA ARWN © 
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Smin = 0.8649 


We determine the values 5,; = D?oo ZZ, and B, = DPoo Viz (kK, 7 = 0, 1, 2): 
Soo LOS Soy = Sig = TITS sop = 8a9 = 63.63. 5j4-—- 1902.6; 
Sia Say = 14197 Sep = 5722s Bo = — 417: 
B, = 494.87; B, = —276.75. 


We write the system of normal equations, but for the time being we do 
replace 8, by their numerical values: 


10a) + 117.50, + 63.60, = Bo, 
117.5a@q + 1902.59a, + 741.970, = By, 
63.609 + 741.970, + 577.220, = By. 
Solving this system by elimination, we find: 
& = —0.60768, + 0.022898, — 0.037548,, 
a, = —0.022898, + 0.0019168, + 0.0000591£., 
a, = —0.037548, + 0.00005918, + 0.0057928,. 


Setting the numerical values of §, in these expressions, we find «,; the 
coefficients of 8, in the expression for a, are the values of N, x: 


ty = =3.621: oe, = —0.01041; O, = —0.06719; 
No.o = 0.6076; Ny, = 0.001916; No. = 0.005792. 


+ 


no 
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Furthermore, we find: S,in = 0.8649 (see Table 91); 
6? = 0.12356; o = 0.3515; 
6%, = 0.07508; a, = 0272; 
62, = 0.0002368 ; Gz, = 0.0154; 
62, = 0.0007156; &,, = 0.0268. 


We construct the confidence intervals for the coefficients «, and for the 
standard deviation o, which determines the accuracy of an individual measure- 
ment, by using Student’s distribution for a, (see Table 16T) and the chi-square 
distribution for o (see Table 19T). 

The number of degrees of freedom is k = n — m = 7 and the confidence 
level is « = 0.90. 

We find: y = 1.897, y, = 0.705, y2 = 1.797. 

The confidence intervals for «,, 


Oe = Pog, Oy Oy + yen; 
become 
—4.141 <a < —3.101, 


—0.0396 <a, < 0.0188, 
—0.1180 <a, < 0.0164, 
and for the standard deviation a 


vid <o<c Yot 
or 


0.2478 <a < 0.6316. 


Example 44.4 Table 92 contains the values x;, y; and the ‘‘weights”’ p? 
that determine the accuracy in measuring y; for a given value x,. 


TABLE 92 





If y is a second-degree polynomial in x, 
VY = Ay + Ax + aox?’, 


find the estimates for the variances of individual measurements of y; and the 
variances of the coefficients a, (kK = 0,1, 2). Construct the confidence limits 
for the unknown true relation y = F(x) at a confidence level « = 0.90. 
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SOLUTION. We compute the quantities s, and v;, for the system of normal 
equations but consider the ‘‘weight”’ of each measurement. The computations 
are given in Table 93. 





TABLE 93 

L pe Vix? 
0 0.50 1.5 13.950 
1 1.00 1.1 4.174 
2 1.00 0.7 0.980 
3 1.00 0.3 0.162 
4 1.00 —0.1 0.024 
5 1.00 —0.5 1.138 
6 1.00 —1.0 8.850 
7 0.50 —-1.5 35.325 
8 0.25 —2.0 97.600 
We obtain: 


7.250; = 0: Sg = 6.300; 


wy 
o~ 
I 


Sg = —1.425; 54 = 11.837; 
40.100; v, = —24,955; ve = 64.366. 


Ss 
&~ 
I 


We write the system of normal equations: 


7.2500 + 0 + 6.3004, 40.100 
O + 6.300a, — 1.425a, = —24.955>-. 
6.300a, — 1.425a, + 11.837a, = 64.366 


We find the numerical values of the determinant A of the system and the 
cofactors 5,, of the elements d,,; = s,,; of this determinant: 


A = 275.87; 800 = 72.54; 8), = 46.12; Sa. = 45.68; 
801 — d10 => — 8.98; 802 = 820 = — 39.69; b10 = 801 a 10.33. 
We compute the estimates of the coefficients a,: 


ws Sx0V0 + 8x11 + Syod9 
aA aaa 


and get 
Gy = 2.096; &, = —3.068; Gz = 3.955. 


We find Smin by performing the computations given in Table 94: 


8 
Siin = 2 Ply — Gy — Gx, — Gyx?] = 0.2208. 
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TABLE 94 


om. 


Gox? y, & 
8.8945 0.0361 
4.7833 0.0031 
1.9370 0.0130 
0.3558 0.0718 
0.0395 . 0.0018 
0.9883 0.0046 
3.9531 : 0.0708 
8.8945 0.0117 

15.8124 0.1274 


20 
45 
00 
80 
40 
55 
85 
70 
40 


6. 
3. 
2. 
1. 
2: 
4. 
8. 
5. 
4. 


SAN hWN © 


1 
2 





Smin = 0.2208 


We compute the estimates of the variances of individual measurements 6? 
by the formula 


6? = Smin = 
n— mp; 
and obtain: 
a ae 0.0368- a4 — 0.0736; 
63 = 62 = 62 = 6? = 62 = 62 = 0.0368; 
of = 0.1472 


The estimates of the variances of the coefficients a, and their covariances 
are given by the formulas 


We have: 
6%, = 0.009336; i, = 0.005936; oc, = 0.005879; 


~ ~ 


Ki,,a, = —9.001156; Kaya, = —0.005108; Ka, 4, = 0.001329. 
We calculate the estimate of the variance 62(x) of ¥ by the formula 


G3(x) = 63, + 62.x? + 62.x* + 2Kay a,x + 2Kay.a,X? + 2Ka,,a.%° 


0,ag 
or by 
62(x) = 1076(933.6 — 231.2x — 428.0x? + 265.8x° + 587.9x*). 
The values o?(x;,) for all x, are calculated in Table 95. 
We construct the confidence limits for the unknown true relation y = F(x): 
Vi — yaflx)<y< A+ yd y(%4), 


where y is determined from Table 16T for « = 0.90 and k = n — m = 6 degrees 
of freedom: 
; y = 1.943. 


The confidence limits for y are computed as in Table 95. 
Similarly one can solve Problems 44.7, 44.8 and 44.11. 
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TABLE 95 


— 428.0x? |265.8x?|587.9x¢| 62(x,) Ae 
y 


x 


— 963.0 | 897.1 | 2976.2 | 0.03497 6.023 
—517.9 : .7 | 0.01375 3.279 
— 209.7 : .2 | 0.00794 1.715 


— 38.5 : 8 | 0.00838 1.353 
— 4.3 E .1 | 0.00953 2.252 
— 107.0 : -7 | 0.01012 4.422 
— 428.0 : 2 | 0.01590 8.871 
0.04197 15.194 

0.11217 23.392 


OUI AARWNHEO 
| 

Nee oooor: 

DUNN wWibW 





Example 44.5 The values of the electric resistance of molybdenum 
depend on temperature T°K as shown in Table 96. 


TABLE 96 
o P> Py» 
T, °K micro-ohm/cm. micro-ohm/cm. 
2289 61.97 37.72 
2132 57.32 32.09 
1988 52.70 28.94 
1830 47.92 





If pis linearly dependent on 7: 
p=a+a,T, 


determine the coefficients a, and a, by the method of least squares. The errors in 
measurements of p and T are specified by the standard deviations o, = 0.8 
and or = 15°, respectively. Find the maximal deviation of the calculated value 
of p from the experimental one. 


SOLUTION. We calculate the quantities s,, 7, (kK = 1,2), v, as shown in 
Table 97. 


TABLE 97 


i T% ; 2 Tip, 107? 
2,289 61.97 : 14,185 
2,132 57.32 : 12,221 
1,988 52.70 10,477 
1,830 : 47.92 8,769 


1,489 37.72 : 5,617 
1,286 32.09 : 4,127 
1,178 28.94 ; 3,409 


DAuhwnNneH Oo 


$1= 12,192 | sg=22,344-10% | 71 =318.66 | re=15,490 | v, =58,805-10 
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We obtain: 


S, = 12,192; So = 22,344-10°; 
r, = 318.66; re = 15,490; 
v, = 58,805-10. 


We write the quadratic equation for the coefficient @,: 


2 

([s? — @ + 1)s2] “8 — (r? — (2 + Vra] : 

a + a a — 3 =0 

Sify — (n + 1), . oF ° 

which, after the substitution of the numerical values, becomes 
G? + 0.0657084, — 0.0028444 = 0. 
Solving this equation, we find two values for d,: 
G11 = 0.029786; G2 ae — 0.095494. 


Obviously, the negative root d,,. is extraneous since the data contained in 
Table 97 show that when T increases p increases. Consequently, 


G, = 0.029786. 


We determine the coefficient d by the formula 


e aT iS 
G ori 6.356. 


We calculate the values of d in Table 97: 
Ei = Pi — Pis 
where f are the computed values of the quantity 


6 = —6.3558 + 0.029786T. 


From the data of Table 97 we find that |e,.,| = 0.28. 
One can solve Problem 44.15 similarly. 


PROBLEMS 


44.1 The results of several equally accurate measurements of the 
depth h of penetration of a body into a barrier for different values of its 
specific energy E (that is, the energy per unit area) are given in Table 98. 


TABLE 98 
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Select a linear combination of the form 
h = ao + aE. 


Determine the estimates 67, of the variances of the coefficients a, and 
the estimate &? of the variance determining the accuracy of an individual 
measurement. 

44.2 Solve the preceding problem by shifting the origin of E to 
the arithmetic mean of E and the origin of h to a point close to the 
expectation of # and thereby simplify the computations. 

44.3 The height / of a body in free fall at time ¢ is determined by 
the formula 

h =a) + ait + aot?, 


where dy is the height at ¢ = 0, a, is the initial velocity of the body and 
dz is half the acceleration of gravity g. 

Determine the estimates of the coefficients do, a;, dg and estimate the 
accuracy of determination of the acceleration of gravity by the indicated 
method, by using a series of equally accurate measurements whose 
results appear in Table 99. 


TABLE 99 





44.4 Solve the preceding problem by using (the orthgonal) Cheby- 
shev polynomials. 

44.5 Several equally accurate measurements of a quantity y at 
equally spaced values of the argument x give the results appearing in 
Table 100. 


TABLE 100 





If y is quite accurately approximated by the second-degree 
polynomial 
= Ap + ayx + Ay xX", 
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determine the estimates of the coefficients @,, the variance of an 
individual measurement 6? and the variances 62, of the coefficients G,,. 

44.6 The amount of wear ofa cutter is determined by its thickness 
(in millimeters) as a function of operating time ¢ (in hours). The results 
are given in Table 101. 


TABLE 101 





Using (the orthogonal) Chebyshev polynomials, express y both 
as a first- and then as a third-degree polynomial of ¢. Considering that 
the results are valid, in both cases estimate the magnitude of the 
variance of an individual measurement and construct the confidence 
intervals for the standard deviation o for a confidence level « = 0.90. 

44.7 The value of the compression of a steel bar x; under a load 
y;, and the values of the variances o?, which determine the accuracy in 
measurements of y;, are given in Table 102. 


TABLE 102 





Find the linear dependence, 
Y= + ax, 


associated with Hooke’s law. Construct the confidence intervals for the 
coefficients a, (kK = 0, 1) and also the confidence limits for the unknown 
correct value of the load for x ranging from 5 to 60 u if the confidence 
level is a = 0.90. 

The “weights” of the measurements corresponding to each value 
x, of the compression are taken inversely proportional to o?. 

44.8 Table 103 contains the average values of y, corresponding to 
the values x, of the argument and also the number n, of measurements 
of y for x = Xj. 
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TABLE 103 





Construct the approximating second-degree polynomial and 
determine the estimates of the standard deviations 6,, of the co- 
efficients @,,. 

44.9 The net cost (in dollars) of one copy of a book as a function 
of the number (in thousands of copies) in a given printing is charac- 
terized by the data accumulated by the publisher over several years 
(Table 104). 


TABLE 104 





Select the coefficients for a hyperbolic dependence of the form 
= Ag + a 
Y= a = 


and construct the confidence intervals for the coefficients (k = 0, 1) 
and also for the quantity y for different values of x, if the confidence 
level is « = 0.90. 

44.10 A condenser is initially charged to a voltage U after which 
it is discharged through a resistance. The voltage U is rounded-off to the 
nearest multiple of 5 volts at different times. The results of several 
measurements appear in Table 105. 


TABLE 105 





It is known that the dependence of U on t has the form 
C= Use": 
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Select the coefficients U, and a and construct the confidence intervals 
for U, and a for a confidence level « = 0.90. 

44.11 The following data obtained from an aerodynamical test 
of a model airplane (see Table 106) express the dependence of the angle 
of inclination 6, (of the elevator ensuring a rectilinear horizontal flight) 
on the velocity v of the air stream: 






v4, m./sec. 







140 6 
160 9 
180 12 






200 






Find the estimates of the coefficients a) and a, and their standard 
deviations. The n; denote the number of measurements for a given value 


of the velocity 2. 
44.12 The results of several measurements of the dimension x of 


a lot of items are divided into intervals and the frequencies p# in Table 
107 are computed for them. 


TABLE 107 





The limits of The limits of The limits of 
the interval Di the interval di the interval pi 


of x1 of x: of x: 


SO to 60 0.00333 100 to 110 | 0.18667 140 to 150 | 0.06333 
60 to 70 0.00667 110 to 120 | 0.20333 150 to 160 | 0.05333 
70 to 80 0.03000 120 to 130 | 0.16333 160 to 170 | 0.01333 
80 to 90 0.07667 130 to 140 | 0.08333 170 to 180 | 0.00667 
90 to 100 0.11000 


If the values of p* refer to the midpoints of the intervals x;,, select, 
by the method of least squares, the parameters for the relation 


x — x)? 
p = poexp {-F)} 


that approximates the experimental distribution. Apply (the orthogonal) 
Chebyshev polynomials. Test whether the resulting dependence obeys 
a,normal distribution law for x; that is, whether the following equation 


holds: 
10 


a 
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44.13 Table 108 contains the measured values of some quantity 
y as a function of time ¢ (for a 20 hour period). 


TABLE 108 
t y t y | t y 

0.00 —25 0.35 26 0.70 —16 
0.05 —26 0.40 32 0.75 3 
0.10 —4 0.45 40 0.80 —21 
0.15 7 0.50 32 0.85 —22 
0.20 6 0.55 21 0.90 —29 
0.25 13 0.60 11 0.95 —32 
0.30 —30 0.65 —5 


If 
degrees 


y = asin(wt — 9), where w = 360 24 hours’ 


determine the estimates of the parameters a and g. Find the maximal 
deviation of the measured quantity y from the approximating function Jf. 
Hint. First choose the approximate value g’ and represent y in the 
form 
y =asin@+ bcos @, 
where 


44.14 Table 109 contains the experimental data for the values of 
a function y = f(x) with period 27. 


TABLE 109 


















Xt; Xi, 














degrees degrees uM degrees “1 
15 195 285 — 2.30 
30 210 2.01 300 —2.22 
45 225 0.92 315 —1.57 
60 240 — 0.24 330 — 1.03 
75 255 —1.23 345 —0.01 














270 360 


Find the representation of this function by the polynomial 


~ 


J =G@ + G,cosx + 6b, sin x + d,cos 2x + by sin 2x 


and the maximal deviation of the measured quantity y from the 
approximating function ¥. 
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44.15 Table 110 contains the levels x and y of the water in a river 
at points A and B, respectively (B is 50 km. downstream from 4A). 
These levels are measured at noon during the first 15 days of April. 


TABLE 110 





If the relation 
y = dog a ax, 


holds, determine the estimates of the coefficients @ and d@, and the maxi- 
mal deviation y; from the calculated values ¥;, if it is known that the errors 
in measurements of x and y are characterized by standard deviations 
F,08y = OSM: 


45. STATISTICAL METHODS FOR QUALITY CONTROL 


Basic Notions 


Quality control methods permit us to regulate product quality by testing. 
A lot of items is sampled according to a scheme guaranteed to reject a good lot 
with probability « (“supplier’s risk’’) and to accept a defective lot with proba- 
bility 8 (“consumer’s risk’’). 

A lot is considered good if the parameter that characterizes its quality 
does not exceed a certain limiting value and defective if this parameter has a 
value not smaller than another limiting value. This quality parameter can be 
the number / of defective items in the lot (with the limits /, and /, > /)), the 
average value of € or A (with the limits €) and €, > & or Ag and A, > Ao), or 
(for the homogeneity control of the production) the variance of the parameter 
in the lot (with the limits of and of > o@). In the case in which the quality of a 
lot improves with the increase of the parameter, the corresponding inequalities 
are reversed. 

There are different methods of control: single sampling, double sampling 
and sequential analysis. The determination of the size of the sample and the 
criteria of acceptance or rejection of a lot according to given values of « and 8 
constitutes planning. 

In the case of single sampling, one determines the sample size mo and the 
acceptance number v; if the value of the controlled parameter is <v in the 
sample, then the lot is accepted, if it is >v, then the lot is rejected. 

If one controls the number (proportion) of defective items in a sample of 
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size Ng, the total number of defective items in the lot being L and the size of the 
lot being N, then 


m Ro —m 
CRCr- 1, 


e=P(M>v|L=1)=1- > a, 
m=0 N 
v Cr Cro,” 
B=P(M<v|L=h)= > a 
m=0 N 


where the values Cf can be taken from Table 1T or computed with the aid of 
Table 2T. 

For n, < 0.1N, it is possible to pass approximately to a binomial distribution 
law 


eS l= Po Cr Pol — Po)*o™™ =1!- P(Po, No, v), 


B a Ch Pil raz pi)’~™ = P(p,, Ho, v), 
where po = /)/N, pi = 1,/N, and the values of P(p,n,d) can be taken from 
Table 4T or computed with the aid of Tables 2T and 3T. 

Moreover, if po < 0.1, p; < 0.1, then letting ag = mopo, a, = Nop, (passing 
to the Poisson distribution law), we obtain 


a q™ 
oo 
a= DY Sem% = 1 — Ply? > x40), 
may+1 M. 
wo 
ay 
B=1- > Set = PO? > xh), 
mav+1 M- 
where 
ee Bl ~ am _ 
Xao aq, Xa1 = a, me 
m=vt+1 mM. 


are given in Table 7T, and the probabilities P(y? > x2) can be obtained from 
Table 17T for k = 2(v + 1) degrees of freedom. 
If 50 < nyo < 0.1N, moPo > 4, then one may use the more convenient 


formulas: 
of? — HoPo + 2 | 
V nopo(l _ Po) 


A ie hive we 05 
oe 50(a = = 22), 
2 2 Viopill — pi) 


where (z) is the Laplace function (see Table 8T). 

If one controls the average value ¥ = (1/m) >?_, x, of the parameter in a 
sample, and the value of the parameter x, of one item obeys a normal distribu- 
tion with known variance o”, then 


sh ot 
2 





«= 5-5 0(2) b= 5-5 0(4 2). 
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For & > &, the lot is accepted if % > v; it is rejected if  < v, and in the 
formulas for « and 8 the minus sign is replaced by plus sign. 
If the controlled parameter has the probability density 


IGy jae, 
a= 1 — P(x? > xiao), 
B P(? 2 xia); 


where xZo = 2MoAgv, x71 = 2oAyv, and the probability P(x? > 2) is determined 
by Table 17T for k = 2no degrees of freedom. If ny > 15, then approximately 


then 


1 2 — 2n, 
P(x? > xa) = 5 — 50( *). 


If one controls the product homogeneity and the quality parameter is 
normal, then 


a = 1 — P(E < goa), B = P(é < qiai), 


where qo = v/a0, Gi = v/a,, 6? = (1/no) >?_-1 (4% — X)* if the expectation x of 
the parameter is known or 





if x is unknown, and the probabilities P(é < ga) are calculated from Table 22T 
for k = no degrees of freedom if x is known and for k = no — 1 if Xis unknown. 

In the case of a double sampling, one determines the sizes n, of the first 
and ng of the second samples and the acceptance numbers », vg, v3 (usually 
vy < [n,/(m, + ng)]v3 < v2). If in the first sample the controlled parameter is 
<v,, then the lot is accepted; if the controlled parameter is >vo, then the lot 
is rejected; in the other cases the second sample is taken. If the value of the 
controlled parameter found for the sample of size (m,; + ng) is <v3, then the 
lot is accepted and otherwise, it is rejected. 

If one controls by the number of defective items in a sample, then 


v2 my ny — My 
Cig Cn 14 


a=|—- 
ny 
m, =0 CK 
v2 my ni —my, vg 7M) m2 ng —m2 
Ci Creg 1 = Ci ay N-lo—ny tm, 
Bg Cr n2 2 
myp=vit1 L N m2=0 N-7, 
vi my ani — my v2 my ny —My Vg—mMy M2 ng — m2 
wae » Ci, Cre, Ci, Cy 1, > Cy On ak +my 5 
B oe Cc™ at Ct n2 
m, =0 N my =v, +1 N mg =0 N-ny 


As in the case of single sampling, in the presence of certain relations between 
the numbers n,, Mg, N, /o, 1, an approximate passage is possible from a hyper- 
geometric distribution to a binomial, normal or Poisson distribution law. 
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If one controls by the average value ¥ of the parameter in a sample, then 
for a normal distribution of the parameter of one item with given variance o” 
in the particular case when 1, = ng = Nn, vy = vg = v, vg = 00, we have 


a=]|-— Pi — 0.5(p2 — pi), B = Pz F 0.5(p, = D3)s 
where 








p25 4: 0.50(— —2), p04 0.50(— 2), 


<B) menos sos) 


For &) > &,, the inequality signs appearing in the conditions of acceptance and 
rejection are reversed and, in the formulas for pj, Po, Ps, pa, the plus sign appear- 
ing in front of the second term is replaced by a minus sign. 

If one controls by ¥ and the probability density of the parameter X for one 
item is exponential: f(x) = Ae~**, ny = ng = N, vy = Vg = ¥, Vg = ©, then 








Ps = 0.5 + 0.50( 


a= 1 —p, — 0.5(p2. — Pi); B = ps3 + 0.5(p4 — p3), 


Pi =1— PQ? 2 xi), Poe = 1 — P(X? > xiv), 
Ps = 1 — PQ? > xa), Ds = 1 — PQ? 2 xn), 


x20 = 2ndgv, x21 = 2nd,v, and the probabilities P(x? > x3) are computed 
according to Table 17T for k=2n degrees of freedom (for p, and p3) and k = 4n 
(for pz and p,). 

If one controls the homogeneity of the production when the controlled 
parameter is normally distributed, m, = n. = n, v; = v3 = v, vg = 0, then 


a= 1—p,—0.5(p.— pi), 8B =p2t 0.5(p, — pd), 


where pi, Po, Pa. Pp, are determined from Table 22T for g and k, and q = qo 
for p, and p.,q = q, for ps and p,; for a known x, k = n for p, and ps3, k = 2n 
for pz and p,; for an unknown x, kK = n — 1 for p, and p3, k = 2(n — 1) for 
pz and py. 

In the sequential Wald analysis for a variable sample size n and a random 
value of the controlled parameter in the sample, the likelihood coefficient y 
is computed and the control lasts until y leaves the limits of the interval (B, A), 
where B = B/(1 — a), A = (1 — B)/a; if y<B, then the lot is accepted, if 
y > A, the lot is rejected and for B < y < A the tests continue. 

If one controls by means of m defective items in a sample, then 


where 


nON-1 
1 Te 
9 ares y(n, m) = prmon-m 

lo’ N-Ig 


For n<0.1LN, a formula valid for a binomial distribution is useful: 


= pre piy 


n,m) >= re 
v ) pol — po) 


where 
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In this case, the lot is accepted ifm < Ah, + nhg, the lot is rejected if m>h, + nhg 
and the tests continue if h; + nh; < m < hg + nh3, where 





log B log A 
eee top ps 
log— 4+ 1 7 log— + lo s 
ae i oe — Pi © Do ey — Pi 
ioe Po 
hes BE Pie 2, 
Pi Po 
log — + lo 
re Tipe 


In Figure 37 the strip II gives the range of values for n and m for which 
the tests are continued, I being the acceptance range, and III being the rejection 
range. 

Ifn < 0.1N, p, < 0.1, then 
ave~% 


3 
age %e 





y(n, m) = 
where dy = po, 4, = np;. For the most part, the conditions for sequential 
control and the graphical method remain unchanged, but in the present case 
log B log A 
Pa log 2 


Po Po 
a 0.4343(p, — Po). 
log 24 


Po 


h, = ? hg = 








? 


log 


hg 


If the binomial distribution law is acceptable, the expectation of the sample 
size 1s determined by the formulas 
Min | pol = (1 — «)log B + «log A ; 


Pi 1 — Po 
log + — (1 — po) log ——£2 
Po logy (1 — po) B ieeeg 


al 

Blog B+ (1 — B)log A 
Bi iy ws 1 = Po 
Piles ce PV METS, 


1 


M[n | Pi] = 


FIGURE 37 
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The expectation of the sample size becomes maximal when the number of 
defective items in the lot is / = Nhg: 


M [7] max — aps tlOe ye a, where Po = Ly Pi — A, 
ing op — Po N N 
Po 1 = py 


If one controls by the average value ¥ of the parameter in the sample and 
the parameter of one item is a normal random variable with known variance o?, 
then 


y = y(n, X) = exp {-3 > [0 — €1)? — Oy - é))} 


The lot is accepted if nX¥<h, + hgn, the lot is rejected if n¥>h. + han and the 
tests are continued if h, + nhg < nX¥ < hg + nhgz, where 

o a fot & 
——— log B; hy = 2.303 ———— log A; hy = 22}. 
£-& * : Te Fe ; 
The method of control in the present case can also be graphically represented 
as in Figure 37 if nX is used in place of m on the y-axis. For €) > &,, we shall 
have h, > 0, A, < O and the inequalities in the acceptance and rejection 
conditions change their signs. 

The expected number of tests is determined by the formulas: 


hy + (I = a) = ha) 


N= 2,303 


M[n | Eo] = 


fo — hg 
hy yo 
Min |g] = 22 PE =, 
M [1] max = es, 


If the parameter of an individual item has the probability density f(x) = Ae~>*, 
then 


- _ At —(A, ~A,)nx 
{n, %) = ne 1 ~ Ain | 
0 


The lot is accepted if nX¥ 2h, + nhzg, it is rejected if nX¥<h, + nhg, and the tests 
are continued if h, + nh; > nX¥ > hy + nhg, where 








= log B . - logA . 
hy = — 2.303 i = Xo? hy —— — 2.303 Ay = No’ 
log 
—_— O . 
hz = 2.303 =e 


The graphical representation of the method of control differs from that repre- 
sented in Figure 37 only because in the present case I represents the rejection 
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region and III represents the acceptance region. The expected number of tests 
is computed by the formulas 


(1 — «) log B + alog A 
ry ee 


Blog B + (i — B)log A 
ri Xo’ 


log ee 0.4343 a 


M([n | Ao] = 


M[n | A,] = 


M[n) max oO Spores 





If the production is checked for homogeneity (normal distribution law), then 


ee a ee _n(e@  6*\) 
Y a y(n, 6) — ot exp { 2 (3 =3)} 


The lot is accepted (for a known x) if né? < hy + nhg, it is rejected if 
no? > h. + nh, and the tests are continued if h, + nhg < na? < hy + nhz, 
where 


2 
2.303 log = 
0 


_ 4.606 log B _ 4.606 log A im 
ee eke ee esl 
are ag? ae 


The graphical representation is analogous to Figure 37 with the values of na? 
on the y-axis. 

If x is unknown, then whenever n appears in the formulas it should be 
replaced by (n — 1). 

The expected numbers of tests are 


ho + (1 = a)(Fy = hg), 


a6 — hs 


_ hy + Bly = hg), 


ai — hy 


M[n | oo] = M[n | 04] 


hyh 
M [7] max S ~ ORE 


If the total number of defects of the items belonging to the sample is checked 
and the number of defects of one item obeys a Poisson law with parameter a, 
then all the preceding formulas are applicable for the Poisson distribution if we 
replace: 


m by nX, Po and p, by ay and ay, dy and a, by nay and nay, x2 by 2nd 
and x21 by 2na,, where n is the size of the sample. 


For n > 50, na > 4, it is possible to pass to a normal distribution 


(2 == 2); 


ae ee 


1d 
m! 2 2 





m=v+1 
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To determine the probability that the number of tests isn < ng in a sequential 
analysis when « « 8 or 8 « «, one may apply Wald’s distribution 


ce (¥% C 1 
P(y < y.) = WAY.) = ve [ y°? exp {-§ (» ci 2) dy, 


where y is the ratio of the number of tests (n) to the expectation of n for some 
value of the control parameter of the lot (/, €, A), ¥y = y|n=n, and the parameter 
c of Wald’s distribution is determined by the following formulas: 


(a) for a binomial distribution of the proportion of the defective product, 














—_— 
plog®* — (1 — p) log; —*2 
= Po Pi ane 
a on Ai eS NE 
1 pos + tog =P) 
PUL — p){log i eas 
(b) for a normal distribution of the product parameter, 
jp- St 
c= | : 
fy = £o @ 
(c) for an exponential distribution of the product parameter, 
2.303 log ¥ sah - Ag 
c=K 2 > 





(> a *s)" 
r 

_ rane B| if the selected value of the parameter is <h3, « « B; 

(2.303 log A if the selected value of the parameter is >/z, B<«Ka. 


where 


A special case of control by the number of defective products arises in 
reliability tests of duration ¢, where the time of reliable operation is assumed to 
obey an exponential distribution law. In this case, the probability p that an 
item fails during time ¢ is given by the formula p = 1 — e~™’. All the formulas 
of control for the proportion of defective products in the case of a binomial 
distribution remain valid if one replaces py by 1 — e~o', p, by 1 — e71". If 
At < 0.1, then it is possible to pass to a Poisson distribution if, in the corre- 
sponding formulas, one replaces ay by nAogt, a, by nAyt, x29 by 2nAot, x21 by 
2ndAxt. 

The sequential analysis differs in the present case because for a fixed 
number ny of tested items, the testing time ¢ is random. The lot is accepted if 
t >t, + mtg, rejected iff > tg + mtg, and the tests are continued if t; + mt, > 
t > te + mtg, where 


log B log A 
ty = —2.303 ———; te = — 2.303 ——>—_;; 
: No(Ay — Ao) a N(Ai — Ao) 
log * 
tg = 2.303 a 


Hig = ae) 
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and m is the number of failures during time ¢. To plot the graph, one represents 
m on the x-axis and ¢ on the y-axis. 

The expectation of the testing time T for At<0.1 is determined by the 
formulas: 


t t 
M[T | Ao] = 7, Ml | pol; M[T | A,] = 7, Min | pil, 


t 
M[T] max = a M[1]max> 


where f, is a number chosen to simplify the computations and po = Aoty, 
Py = Ayty. 

To determine the probability that the testing time T < t,ifa <« BorB «a, 
one applies Wald’s distribution in which one should set y = ¢/M[T | A] and 
find the parameter c by the formula valid for a binomial distribution for the 
preceding chosen value of ty. 


SOLUTION FOR TYPICAL EXAMPLES 


Example 45.1 A lot of N = 40 items is considered as first grade if it 
contains at most /, = 8 defective items. If the number of defective items exceeds 
1, = 20, then the lot is returned for repairs. 


(a) Compute « and f by a single sampling of size m) = 10 if the acceptance 
number is v = 3; 

(b) find « and 8 for a double sampling for which n, = nz = 5, vy, = 0, 
p= 2. ve ae 

(c) compare the efficiency of planning by the methods of single and double 
samplings according to the average number of items tested in 100 identical lots; 

(d) construct the sequential sampling plan for « and f obtained in (a), 
determine 7,,;, for the lots with L = Oand L = N. 


SOLUTION. (a) We compute « and £ by the formulas 
3 moilo— 3 
CaCae ” = ok. m glo—m 
2, ce P= ce 2, CECH. 


Using Table 1T for C?, we find 
« = 0.089, B = 0.136. 


a=l1- 


(b) We compute « and 8 by the formulas 


a=l—oe > cect + > eae ( - > ee a8), 
Cio m=0 m,=1 C25 mo =0 35 
ga C20Ct0 s Ee SS" CH3_m,Cista, 
7 C3, C8; |; 


mg =0 


and obtain 
a = 0.105, B = 0.134. 
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(c) The probability that a first-grade lot in the case of double sampling 
will be accepted after the first sampling of five items is 
C8C32 
Cho 





P(m, < »,) = P(m, = 0) = = 0.306. 


The expectation of the number of lots accepted after the first sampling 
from a total number of 100 lots is 


100-0.306 = 30.6 lots; 


for the remaining 69.4 lots a second sampling is necessary. The average number 
of items used in double sampling is 


30.6-5 + 69.4-10 = 847. 
In the method of single sampling, the number of items used is 
100-10 = 1000. 


In comparing the efficiency of the control methods, we have neglected 
the differences between the values of « and 8 obtained by single and double 
sampling. 

(d) For «a = 0.089 and 8 = 0.136 the plan of sequential analysis is the 
following: 


B=; P__ 0.149, log B = —0.826, 
1 





a 
SP O57), deed 0087 


a 


A= 





To determine 7,,;, when all the items of the lot are nondefective, we compute 
the successive values of log y(n; 0) by the formulas 
log y(1; 0) = log (N — /,)! + log(N — J, + 1)! 
— log (N — /,)! — log(N — 4, + 1)!, 
log y(n + 1; 0) = log y(n; 0) — log (N — Jy-— n)! + log(N — 1, — n)! 
We have: 
log y(1; 0) = 0.7959; log y(2; 0) = 0.5833; 
log y(3; 0) = 0.3614; log y(4; 0) = 0.1295; 
log y(5; 0) = —0.1136; log (6; 0) = —0.3688; 
log y(7; 0) = —0.6377; log 7(8; 0) = —0.9217. 
Since the inequality log y(n; 0) < log Bis satisfied only if n > 8, it follows 
that Asin En 8. 
For a lot consisting of defective items, n = m. We find log y(1; 1) = 0.3979. 
For successive values of n, we make use of the formula 
log ym + 1; m + 1) = log y(n; m) + log (, — m) — log (lp — m). 


We obtain log 7(2; 2) = 0.8316; log y(3; 3) = 1.3087 > log A = 0.987; con- 
sequently, in this case Ayin = 3 
Similarly one can solve Problem 45.1. 


356 METHODS OF DATA PROCESSING 


Example 45.2 A large lot of tubes (N > 10,000) is checked. If the pro- 
portion of defective tubes is p < po = 0.02, the lot is considered good; if 
P > p, = 0.10, the lot is considered defective. Using the binomial and Poisson 
distribution laws (confirm their applicability): 

(a) compute « and § for a single sampling (single control) ifm = 47,» = 2; 

(b) compute « and 8 for a double sampling (double control) taking 
ny = Mz = 25, ¥, = 0, ve = 2, ¥3 = 2; 

(c) compare the efficiency of the single and double controls by the number 
of items tested per 100 lots; 

(d) construct the plan of sequential control, plot the graph and determine 
Mmin for the lot with p = 0, p = 1, compute the expectation for the number of 
tests in the case of sequential control. 


SOLUTION. (a) In the case of binomial distribution, 


2 2 
a= 1]— > C#0.0270.9847-", B= > C0.1070.9047-™. 
m=0 m=0 
Using Table 4T for the binomial distribution function and interpolating 
between n = 40 and n = 50, we get « = 0.0686, 8 = 0.1350. 
In the case of a Poisson distribution law, computing a = nopo = 0.94, 
= 4,7, we obtain 


<. 0.94%e — 0-94 2 4 JMme-4.7 
pe 
m=3 mM. m=3 


a, = NoP1 


m! 


Using Table 7T, which contains the total probabilities for a Poisson distribution, 
we find (interpolating with respect to a) 


a = 0.0698, B= 0.159. 
(b) For a binomial distribution law, using Table 1T and 4T, we find 


2 
= C™0.02710.9875—™ 
] & 3 Oo? 


a= 
2-—my, 
oS [cazo.02m0.98%-"(1 s >. C330.02"20.9875-ns) = 0.0704, 
m4 =1 m2= 
2 2-my, 
mn my; —m m Mo() O25 -—m = 
g = C9,0.1909" +2, [czs0.1™0.9%-m (5° CB¥0.1%0.9%°-"2)] = 0.1450, 


In the case of a Poisson distribution law, using Tables 6T and 7T and 
7 0.5, doo = 0.5, ay; = 2.5, dp = 2.5, we obtain 


computing @o1 





wo 0.5™e7 °° 
a= “5 m,! 
m= 2 ra ea -0.5 
0.5%e- 05 0.52 )| 
if = 0.0715, 
2s | m,! os My! 
a > 571 @~ 0-25 

p= Li o m,! 


2 My p — 2.5 2, 2. 5™2e 2-5 
+ > se = (: = > a) = 0.1935. 
! ae 
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The essential difference between the values of 8 computed with the aid of 
binomial and Poisson distributions is explained by the large value of p, = 0.10. 

(c) The probability of acceptance of a good lot (p < 0.02) after the first 
sampling in the case of double control (we compare the results of the binomial 
distribution) is 

Pim, < v,) = P(m, = 0) = C$,0.02°-0.987° = 0.6035. 

The average number of good lots accepted after the first sampling from the 

total number of 100 lots is 
100-0.6035 = 60.35. 


For the remaining 39.65 lots, a second sampling will be necessary. The average 
expenditure in tubes for a double control of 100 lots is equal to 


60.35-25 + 39.64.50 = 3497. 


In a defective lot, the probability of rejection after the first sampling in the case 
of double control is 


2 
P(m; > v2) =P(m, > 2)= 1 — 5 CB80.1"0.99-™ = 0.4629. 


my = 


The average number of lots rejected after the first sampling from a total of 
100 lots is 
100-0.4629 = 46.29. 


For the remaining 53.71 lots a second sampling will be necessary. The average 
expenditure in tubes for a double control of 100 lots will be 


46.29-25 + 53.71.50 = 3843. 
For a single control, in all cases 


100-50 = 5000 tubes 
will be consumed. 
(d) For « = 0.0686, 8 = 0.1350 for a sequential control, using a binomial 
distribution we get: 


B = 0.1450, log B = —0.8388, A = 1.261, log A = 1.1007. 


Furthermore, 4, = —1.140, h, = 1.496, hg = 0.0503 (Figure 38). We find ryan 
for a good lot for p = 0: 


h 1.140 
0 = hy + Mainhs, tin = = = 2257 235 
: as : hg 0.0503 
for a defective lot when p = |: 
Amin = he + Mminhs, 
hy 1.496 


als ae ae | Ae 


We determine the average numbers of tests for different p: 


M[n | 0.02} = 31.7; M[n|0.10] = 22.9;  Mlr}max = 35.7. 
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FIGURE 38 





Problems 45.2 to 45.5, 45.7, 45.8 and 45.10 can be solved by following this 
solution. 


Example 45.3. A large lot of resistors, for which the time of reliable 
operation obeys an exponential distribution, is subjected to reliability tests. 
If the failure parameter A < A, = 2-10~® hours™?, the lot is considered good; 
if A > A, = 1-10~° hours~?, the lot is considered defective. Assuming that 
Ato < 0.1, where fg is a fixed testing time for each item in a sample of size no, 
determine for a = 0.005, 8 = 0.08, the value of mp. Use the method of single 
sampling for different fo, find v with the condition that tj = 1000 hours and also 
construct the plan of sequential control in the case n = no for tg = 1000 hours. 
Compute fnin for a good lot and a defective one and M[T| A], P(t < 1000), 
P(t < 500). 


SOLUTION. The size mo of the sample and the acceptance number » are 
determined by noting that Afyp < 0.1, which permits use of the Poisson distribu- 
tion and furthermore, permits passing from a Poisson distribution to a chi- 
square distribution. We compute the quotient A g/A, = 0.2. Next, from Table 
18T we find the values 2) for the entry quantities P(x? > x29) = 1 — « = 0.995 
and k; xa for P(x? > x21) = B = 0.08 and k. 

By the method of sampling, we establish that 

fork = 15 


2 
x20 = 4.48, x2, = 23.22, - = 0.1930; 
ql 
for k = 16 
2 
x20 = 5.10, x21 = 24.48, a = 0.2041. 
Interpolating with respect to xo/xq. = 0.2, we find: k = 15.63, xgo = 4.87, 
X21 = 23.99. We compute v = (k/2) — 1 = 6.815; we takev = 6, 2nM9Agto = 4.87, 


hence, it follows that mofo = 4.87/2-0.000002 = 1.218-10°®. The condition 
Ato < 0.1 leads to 


to < 0.1/0.00001 = 10,000 hours (since A, = 0.00001). 


Taking different values tp < 10,000, we obtain the corresponding values of ig 
given in Table 111. 
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TABLE 111 





500 1000 2500 5000 


to in hours 100 


No 12,180 2436 1218 487 244 





We compute B, A, f1, to for the method of sequential analysis: B = 0.08041, 
In B = —2.5211, A = 184, In A = 5.2161. Taking nm) = 1218, we have 


t, = 258.7 hours; 
to = — 535.3 hours, 
ts = 165.2 hours (Figure 39). 
The minimal testing time in the case when m = 0 for a good lot is tmin = 258.7 
hours; for a defective lot tmin = —535.3 + 165.2m > 0; m = 3.24 & 4; for 
m = 4, tmm = 125.5hours. Iffort < 125.5 hours m > 4, then the lot is rejected. 
To compute the average testing time for n = my) = 1218, we take 
ty = to = 1000 hours. Then 
Po et Aoty = 0.002; 
Pi = Ayty = 0.010; 


Mty at = 0.00497. 
03 


Furthermore, we find 
M[xn | po] = 505, M[x | pi) = 572, M[7n]max = 1001; 


FIGURE 39 
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then we compute 
M([Z7 | Ao] = 415 hours, M[Z7 | 4,] = 470 hours, 
M[T]max = 821 hours. 


We find the probability that the testing time for a fixed number of items 
nh = No = 1218 is less than 1000 hours and 500 hours. Therefore, for ty = 1000 
hours, we compute the value of the parameter c of Wald’s distribution and the 
value of 
age SUN he ee 
** Min | po) MITT] 


with the condition that po = Aogtp = 0.002; py = Ayto = 0.01. Taking p = po 
since « «< 8, we obtain c = 2.37, y = 1000/415 = 2.406. We find that (see 
Table 26T) 


P(T < 1000) = P(n < 1218) = W,{y) = 0.9599. 
For y = 0.5, we have 
y = 1.203, P(T < 500) = 0.725. 
One can solve Problem 45.9 similarly. 


Example 45.4 The quality of the disks produced on a flat-grinding 
machine is determined by the number of spots on a disk. If the average number 
of spots per 10 disks is at most one, then the disks are considered to be of good 
quality; if the average number is greater than five, then the disks are defective. A 
sample of 40 disks is selected from a large lot (N > 1000). Assuming that the 
number of spots on a disk obeys a Poisson distribution law: 

(a) determine « and f for v = 9; 

(b) for these « and § construct the plan of sequential control, compute 
Nmin for a good lot and a defective one and find the values of M[n | a]; 

(c) test a concrete sample, whose data appear in Table 112, by the methods 
of single and sequential control. 


TABLE 112 





NNNNEEEE 
PAPPHAHLAD 
SIAKDUWAD 





DIAN BWNe 


| 22 30 
23 31 
32 


SOLUTION. (a) Using the Poisson distribution, we have ay = 0.1, a, = 0.5, 
Nady = 4, na, = 20. Using Table 7T for the total probabilities of x, occurrences 
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of spots on disks in the sample, we find 


- 4*ne~ +4 2 X_ 9-20 
a a = 0.00813, g=I— > 20""€~ 0.00500. 


Xn =10 . xn =10 Xn? 





(b) For « = 0.0081, 8 = 0.0050, the characteristics of the sequential 
control (Figure 40) are: 


B = 0.005041; log B = —2.298; A= "122.8; log A = 2.089, 





eee a oe ee 
log 2 log 4 
ao P ao 
ia Ze ose = Ao) — 0.248 
Q 
log 5 


We compute Aypin: 
for x, = Q, Nog = 132 14 
for x, =A, a — a Oe eal Be 
The average number of tests in the case of sequential control is 
M[n | ao] = 21.8; M[n | a,j = 11.8; Miz).g2= 395: 
(c) In a sample with m, = 40, it turns out that x, = 7 < v = 9; conse- 
quently, the lot is accepted. Applying the method of sequential control (see 


Figure 40), for » = 30 we obtain that the point with coordinates (n, m) lies 
below the lower line; that is, the lot should be accepted. Indeed, 


for n=29, x, = 4h, + mhg = 3.90; x, > Ay + ms; 
for n= 30, X, = 44, + mhs = 4.15; x, < hy + mhz. 
Similarly one can solve Problem 45.11. 


Example 45.5 The quality of punchings made by a horizontal forging 
machine is determined by the dispersion of their heights XY, known to obey a 





FIGURE 40 
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normal distribution law with expectation x = 32 mm. (nominal dimension). 
If the standard deviation o < og = 0.18 mm., the lot is considered good; if 
a > o, = 0.30 mm., the lot is defective. Find « and 8 for the method of single 
sampling if m7 = 39 and vy = 0.22 mm. Use the resulting values for « and § to 
construct a control plan by the method of sequential analysis. Compute *min 
for a good lot and a defective one and find M[n | co]. 


SOLUTION. We compute « and 8 by the formulas 
a = 1 — P@ < goop), B = P@ < qin), 
fork = no = 39,9 = vi/og = 1.221, q, = v/o, = 0.733. Interpolating according 
to Table 22T for the chi-square distribution, we find 
a = 0.0303; B = 0.0064. 
We find the values of B, A, hy, ha, hz for the method of sequential analysis: 


B = 0.006601 ; In B = —5.021; A = 30.10; In A = 3.405: 
hy, = —0.528; h, = 0.345; hg = 0.0518. 


We find nzi,. For the poorest among the good lots, 6? = of = 0.0324; 
Nene = hy Ueielas Taig = 21.2. 2 28. 

For the best among the defective lots, ¢? = o? = 0.0900; nyino? = hy + 
hehe, f= "93 =: 10, 

We compute the average numbers of tests M[n | c] for different oc: 


M[x | oo] = 25.9; M[n | o,] = 8.8; M[”] max = 34.0. 
In a similar manner, one can solve Problem 45.12. 


Example 45.6 The maximal pressure X in a powder chamber of a rocket 
is normally distributed with standard deviation o = 10 kg./cm.?. The rocket is 
considered goodif X < € = 100 kg./cm.?;if ¥ > €, = 105kg./cm.?, the rocket 
is returned to the plant for adjustment. Given the values « = 0.10 and 8 = 0.01, 
construct the plans for single control (m9, v) and sequential control, compute 
the probabilities P(m < n)) and P(m < (1/2)n,) that for the sequential control 
the average number of tests will be less than ny and (1/2)no, respectively. 


SOLUTION. To compute the sample size m) and the acceptance number v 
for a single control, we use the formulas 


a et Ae 


Substituting the values for « and 8 and using Table 8T for the Laplace function, 
we find 








v — 100 
10 


105 — v 
10 





Vino = 1.2816, Ving = 2.3264; 
hence, it follows that mp = 52, v = 101.8 kg./cm.?. 

For the sequential control, we find that B = 0.0111, In B = —4.500, 
A = 9.9,1n A = 2.293, hy = —90, ho = 45.86, hg = 102.5. 
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We determine A,;,. For the poorest among the good lots, when 
¥ = & = 100, 
Amin’ 100 = —90 + nyin- 102.5; Nmin = 36; 
for the best among the defective lots when ¥ = €, = 105, 
Amin? 105 = 45.86 + Myin: 102.5; an = 183-2 19. 
The average number of observations M[n | €] is equal to 
M[n| &] = 30.6; M[n|é:)= 17.8;  M[t)max = 41.3. 


To determine the probability P(m < 52) since « « B for x = &, = 105, 
we compute: 
K=1nA = 2.293; c = 1.146; 


= No 
7 Min | &] 


From Table 26T for Wald’s distribution law we find that 
P(n < 52) = 0.982, P(n < 26) = 0.891. 


By following this solution one can solve Problem 45.13. 


— 4.031; Vie2 = sot = 2.016. 


Example 45.7 The average time of operation of identical electron tubes 
represents t > tg = 1282 hours for a good lot and ¢ < t, = 708 hours for a 
defective one. It is known that the time T of reliable operation obeys an expo- 
nential distribution law with the probability density 


f(t) = re™, 


where the parameter A is the intensity of failures, that is, the inverse of the mean 
time of operation of a tube in hours. 

Determine for a = 0.001 and 8 = 0.01, the size m) of the single sample 
and the acceptance number », construct the sequential control plan and find 
Nminy M[n | A], P(n < 19), Pw < (1/2)no). 


SOLUTION. Assuming that m) > 15 (since « and 8 are small), we replace 
the chi-square distribution, which the quantity 2An)/A obeys, by a normal 
distribution; i.e., we set 


2 _ In 
PQ? > x?) = 0.5 — 0.50(4—"), 
(x* > xa) SVE 


since the number of degrees of freedom is kK = 2n. We obtain the equations 


4a Dh 
0.5 — 0,50( 2 : }- . 
2Vn B 
hence, it follows, from Table 8T, that 
Xgo — 2n Xa. — 2n 


Ago =" = —3.090, 
2Vn 2Vn 
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or, since ven => 2AgMov, Xai => 2A Nov, Xo = 1/to = 0.00078, Ay = 1/ty = 0.001413, 


0.000780 — v = —3.090 —, 
( Vn, 

0.001413:= v= 2.324 —_. 
’ Vn, 


If we solve this system of equations, we obtain 
vy = 0.001141, No = 99.03 ~ 100. 


Since My > 15, the use of a normal distribution is permissible. 
For the sequential control, we find that: 


B = 0.01001; In B = —4.604; A = 990; In A = 6.898; 
h, = 7273; hg = — 1090-10; hs = 938.0; 


oS J = 0.001066. 
hs 
We determine 7,,;,. For the poorest among the good lots, 7 = tg = 1282 hours, 
Amin = 21.1 % 22; for the best among the defective lots, 7 = t, = 708 hours, 
Mmin = 47.4 & 48. 
We find the average numbers of tests for different A: 


M[n| Ao] = 20.7; M[n| A] = 46.6; MII max = 90.0. 


Since « « 8, we determine K = |In B] = 4.604 and, then, the parameter c 
of Wald’s distribution: c = 1.525; furthermore, we find yp, = 100/20.7 = 4.82; 
Yoo = 2.41. 


From Table 26T, for yo;(yo2) and c, we have 
= P(n < 100) > 0.99 (for p < 0.999), 
P(n < 50) = 0.939. 
Similarly Problem 45.14 can be solved. 


PROBLEMS 


45.1 Rods in lots of 100 are checked for their quality. If a lot 
contains L < J, = 4 defective items, the lot is accepted; if L > 1, = 28, 
the lot is rejected. Find « and 8 for the method of single sampling if 
No = 22, v = 2, and for the method of double sampling for n, = n,. = 15, 
v,=0, vo =3, v3 =3; compare their efficiencies according to the 
average number of tests; construct the sequential analysis plan and 
compute the minimal number of tests for a good lot and a defective 
one in the case of sequential control. Use the values of « and 8 obtained 
by the method of single sampling. 

45.2 In the production of large lots of ball bearings, a lot is 
considered good if the number of defective items does not exceed 1.5 
per cent and defective if it exceeds 5 per cent. Construct and compare 
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the efficiency of the plan of single control, for which the sample size 
No = 410 and acceptance number v = 10, and the plan of double control, 
for which ny; = no = 220, pp] 2, vp = 7,43 11, 

Construct the sequential control plan with « and 8 as found for the 
plan of single control. Compare the efficiencies of all three methods 
according to the average number of tests and compute 1, for a good lot 
and a defective one for sequential control. 

45.3 A large lot of punched items is considered good if the 
proportion of defective items p < po = 0.10 and defective if p > p, = 
0.20. Find « and § for the control by single sampling: use sample size 
Ny = 300 and acceptance number v = 45. For the resulting values of 
a and 8, construct the control plan by the method of sequential analysis 
and compute “pin for a good lot and a defective one; find M[n | p] and 
P(n < No), P(n < (1/2)ro). 

Hint: Pass to the normal distribution. 

45.4 For a large lot of items, construct the plan of single control 
(Mo, v) that guarantees (a) a supplier’s risk of 1 per cent and a con- 
sumer’s risk of 2 per cent, if the lot is accepted when the proportion of 
defective items is p < pp = 0.10 and rejected when p > p, = 0.20 (use 
the normal distribution), (b) « = 0.20, 8 = 0.10 for the same poy and p, 
applied to a Poisson distribution law. Construct the corresponding 
plans of sequential control and find the expectations for the number of 
tests. 

45.5 For « = 0,05 and 8 = 0.10, construct the plans of single and 
sequential control for quality tests of large lots of rivets. The rivets are 
considered defective if their diameter X > 13.575 mm. A lot is accepted 
if the proportion of defective rivets is p < po = 0.03 and rejected if 
P > Pp; = 0.08. Compute, for a Poisson distribution, the size ny of the 
single sample and the acceptance number v. For the same « and 8, con- 
struct the plan of sequential control, compute #in for a good lot and a 
defective one and find the average number of tests M[n |p] in a 
sequential control. 

45.6 Rivets with diameter X > 13.575 mm. are considered defec- 
tive. At most 5 per cent of the lots whose proportion of defective items 
is Dp < Po = 0.03 may be rejected and at most 10 per cent of lots whose 
proportion of defective items is p > p, = 0.08 may be accepted. 
Assuming that the random variable X obeys a normal distribution whose 
estimates of the expectation ¥ and variance 6? are determined on the 
basis of sample data, find the general formulas for the size ng of the 
single sample in dimension control and for Zp such that the following 
condition is satisfied 


P(X + 62) > 1|p = po) = 4, 
P(¥+6z,>/\|p=pi)=1-8. 


Compute ny and Zy for the conditions of the problem. 
Consider the fact that the quantity 


u=X+4+ 625 
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is approximately normally distributed with parameters 


2 
M[u] = %+0z, Du] = o°(= a st), 
where k = n — 1. Compare the result with that of Problem 45.5. 

45.7 Using the binomial and Poisson distributions, construct the 
plan of double control for ny = np = 30, », = 3, vo = 5, vg = 8, if a 
lot is considered good when the proportion of defective items is 
P S Po = 0.10 and defective when p > p, = 0.20. For the values « and 
8 found for the binomial distribution, construct the plans of single and 
sequential control, compare all three methods according to the average 
number of tests. For the sequential control, find n,;, for a good lot 
and a defective lot and compute the expectation of the number of tests 
M[n | 7). 

45.8 Construct the control plans by the methods of single and 
sequential sampling for large lots of radio tubes if a lot with proportion 
of defective items p < po = 0.02 is considered good and with p > p, = 
0.07 is considered defective. The producer’s risk is 2 = 0.0001 and the 
consumer’s risk is 8 = 0.01. For the plan of sequential control, deter- 
mine 7,3, for a good lot and a defective one, find the average number of 
tests M[xz | p} and the probabilities P(n < M[n | po}), P(n < 2M[x | pp). 

45.9 The time of operation T (in hours) of a transformer obeys 
an exponential distribution with an intensity of failures A. Assuming 
that Afp < 0.1, construct the plans of control by single sampling and 
sequential analysis for « = 0.10, 8 = 0.10. For the single control, find 
the acceptance number v and the size ny of the sample if the testing period 
of each transformer is fg = 500, 1000, 2000, S000 hours. (Replace the 
Poisson distribution by a chi-square distribution.) For the sequential 
control, take a fixed sample size ny corresponding to fg = 1000 hours 
and find the average testing time of each transformer M[T7 | A]. Assume 
that a lot of transformers is good if the intensity of failures 
A < A, = 107° hours~* and defective if A > A, = 2.1075 hours}. 

45.10 A large lot of electrical resistors is subjected to control for 
a = 0.005, 8 = 0.08; the lot is considered good if the proportion of 
defective resistors is p < po = 0.02 and defective if p > p, = 0.10. 
Applying a chi-square distribution instead of a Poisson one, find the 
siZe No and the acceptance number v for the method of single sampling; 
construct the plan of sequential control for a good lot and a defective 
lot; compute the expectation of the number of tested items and the 
probabilities P(n < ny), P(n < (1/2)no). 

45.11 Before planting, lots of seed potatoes are checked for rotting 
centers. A lot of seed potatoes is considered good for planting if in each 
group of 10 potatoes there is at most one spot and bad if there are five 
spots or more. 

. Assuming that the number of spots obeys a Poisson distribution, 
compute a and £8 for the method of double sampling if n, = 40, 
No = 20, 7 = 4, vo = 12, v3 = 14. For the resulting values of a and 8, 
construct the plans of single and sequential control. Compare the 
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efficiencies of all three methods according to the mean expenditures 
of seed potatoes necessary to test 100 lots. 

45.12 The quality characteristicin a lot of electrical resistors, whose 
random values obey a normal distribution law with a known mean of 
200 ohms, is the standard deviation o, and the lot is accepted ifo < a, = 
10 ohms and defective if o > o, = 20 ohms. Construct the control 
plans by the method of single sampling with np = 16, vy = 12.92 and 
double sampling with n, = ng = 13, vy = vg = 12, vp = «©. For the 
resulting values of « and £ (in the case of single control), construct the 
plan of sequential control. Compare the efficiencies of all three methods 
of control according to the average number of tests. Compute “mi, for 
the poorest among the good lots and the best among the defective 
lots. 

45.13 Several lots of nylon are tested for strength. The strength 
characteristic X, measured in g./denier (specific strength of the fiber), 
obeys a normal distribution with standard deviation o = 0.8 g./denier. 
A lotis considered good if Y¥ > x, = 5.4g./denier and badif ¥ < x, = 
4.9 g./denier. Construct the plan of strength control by single sampling 
with nm, = 100 and v = 5.1. For the resulting values of @ and 8, 
construct the plan of control by the method of sequential analysis, 
compute the mean expenditure in fibers and the probabilities P(n < no), 
P(n < (1/2)n). 

45.14 Itis known that if the intensity of failures is A < Ay = 0.01, 
then a lot of gyroscopes is considered reliable; if A > A, = 0.02, the lot 
is unreliable and should be rejected. Assuming that the time T of reliable 
operation obeys an exponential distribution and taking « = 8 = 0.001, 
construct the plans for single (mg, v) and sequential controls according 
to the level of the parameter A. Find the average number of tested gyro- 
scopes M[n | A] for the case of sequential control. 

45.15 A large lot of condensers is being tested. The lot is con- 
sidered good if the proportion of unreliable condensers isp < py = 0.01; 
forp > p; = 0.06 the lot is rejected. Construct the plan of single control 
(vg, v) for the proportion of unreliable items so that « = 0.05, 8 = 0.05. 

To establish the reliability, each tested condenser belonging to the 
considered sample is subjected to a multiple sequential control for 
a’ = 0.0001, 8’ = 0.0001 and a condenser is considered reliable if the 
intensity of failures A < Ay = 0.0000012 and unreliable for A > A, = 
0.0000020 hours~? (m is the number of tests used to establish the 
reliability of a condenser for given @’ and 8’). One assumes that the time 
of reliable operation of a condenser obeys an exponential distribution. 

45.16. Construct the plans of single and sequential controls of 
complex electronic devices whose reliability is evaluated according to the 
average time 7 of unfailing (reliable) operation. If T > TJ) = 100 hours, 
a device is considered reliable and if 7 < 7, = 50 hours, unreliable. 
It is necessary that « = 8 = 0.10. Consider that for a fixed testing time 
tp a device is accepted if tp/m = T > v and rejected if T < v, where m 
is the number of failures for time ¢, and vis the acceptance number in the 
case of single control (w) = 1; in case of failure the device is repaired 
and the test is continued). In this case, t;/T obeys approximately a 
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Poisson distribution. In the case of sequential control, the quantity rf 
depends on the progress of the test. 

(a) Determine the testing time tp and the acceptance number » for 
a single control. 

(b) For the plan of sequential control, reduce the condition for 
continuation of the tests In B < In y(t, m) < In A to the form ft; + 
Mtg >t > tg + mts. For t,, ta, ts, obtain, preliminary general 
formulas. 

(c) In the case of sequential control, determine the minimal testing 
time tmin for the poorest of the good lots and the best of the rejected ones. 


46. DETERMINATION OF PROBABILITY CHARACTERISTICS 
OF RANDOM FUNCTIONS FROM EXPERIMENTAL DATA 


Basic Formulas 


The methods of determination of the expectation, the correlation function 
and the distribution laws of the ordinates of a random function by processing 
a series of sample functions does not differ from the methods of determination 
of the corresponding probability characteristics of a system of random variables. 
In processing the sample functions of stationary random functions, instead of 
averaging the sample functions, one may sometimes average with respect to 
time; i.e., find the probability characteristics with respect to one or several 
sufficiently long realizations (the condition under which this is possible is 
called ergodicity). In this case, the estimates (approximate values) of the ex- 
pectation and correlation function are determined by the formulas 


inn, Se 
x= zi, x(t) dt, 


Ro) = pte bt) - ale +) ~ aa, 


where 7 is the total time of recording of the sample function. Sometimes instead 
of the last formula one uses the practically equivalent formula, 


Rae — i Ones Dares. 


In the case when the expectation X is known exactly, 


1 


K,(7) = Tod i [x(t) = x] [x(t + 7) _— x] dt 


T=% 
x z— | x(t)x(t + r)dt — Kes 
ie 0 
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If % and K,(r) are determined from the ordinates of a sample function 
of a random function at discrete time instants t; = (j — 1)A, the corresponding 
formulas become 


1 m 
x= m Z x(t;), 


Roo) = GD [alt — allay +) — 5 


or 


m—l 
Ra) = aD, Medes + 9) ~ 3, 
where + = JA, T= mA. 

For normal random functions, the variances X and K,(7) may be expressed 
in terms of K,(7). In practical computations; the unknown correlation function 
K,(7) in the formulas for D[%] and D[K,(7)] is replaced by the quantity K,,(r). 

When one determines the value of the correlation function by processing 
several sample functions of different durations, one should take as the approxi- 
mate value of the ordinates of K,(7) the sum of ordinates obtained by processing 
individual realizations whose weights are inversely proportional to the variances 
of these ordinates. 


SOLUTION FOR TYPICAL EXAMPLES 


Example 46.1. The ordinates of a stationary random function are deter- 
mined by photographing the scale of the measuring instrument during equal 
time intervals A. Determine the maximal admitted value of A for which the 
increase in the variance of K,(0) compared with the variance obtained by 
processing the continuous graph of realization of a random function will be at 
most § per cent if the approximate value of K,(r) = ae~“'*! and the total 
recording time T is >1/e. It is known that x = 0 and the function X(t) can 
be considered normal. 


7 SOLUTION. Since x = 0, by use of the continuous recording, the value of 
K,,(0) is determined by the formula 


a 1 (7 
K,(0) = = i (t) dt. 
1( ) T 5 x ( ) 
For finding the variance of K,(0), we have 
* x = yo PEt 
D[K(0)] = MIRH0)] — (MIKO? = Za | | KE — 1) dts dt 
~ 4 2 7 —2at 
® 734 ee Oe dr. 
If after integration we eliminate the quantities containing the small (by 


assumption) factor e~°7, we get 


a? 
T? oc? 


D[K,(0)] = (2eT — 1). 


370 METHODS OF DATA PROCESSING 


If the ordinates of the random function are discrete, the value of K,,(0) is 
5 1 <2 : 
RO) = 5 2, 27UA)- 

Determining the variance of K,(0), we find that 


D[K,(0)] 


Als XH 


ne > > MLuayx70a)] — m? KYO) 
22, 2 K2(IA — jA), 


where for the calculation of the expectation one uses a property of moments of 
systems of normal random variables. 


Using the value of K,(7), we obtain 


D[K,(0)] = = Oe 


_ 2a2A T(1 — e7 #84) — 2Ae- 228 
“T2 a = ears 


S 


m 2a? 
—_ -2arQ _ 7 
a2, (m — re - 


The limiting value of A is found from the equation 
D[K;(0)] 
D[K,(0)] 

that is, from the equation 


= 1+ 0.018; 


2o2A[T(1 — e- 424) — 2Ae-224] 
Ora hi eer a Oe: 


For «A « 1, we obtain approximately 


eee V 25x? + 12(1 — 11k) _ 2eT—-~1 8 
7 2(1 — 11k) @ ~ 2eT — 3 100 


PROBLEMS 
46.1 Prove that the condition 
lim K,(7) = 0 


is necessary in order that the function X(t) be ergodic. 
46.2 Verify whether the expression 


a 1 
S,(w) = T 





T 2 
| eT x(t) dt 
0 


may be taken as an estimate of the spectral density if X(t) is a normal 
stationary random function (¥ = 0) and ie |K(z)| dt < o., 
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46.3 To determine the estimate of the correlation function of a 
stationary normal stochastic process X(t) (x = 0) a correlator is used 
that operates according to the formula 


a ] T-t 
K.A(7) = [cae if x(t) x(t + T) dt. 
Derive the formula for D[ K,(7)]. 


46.4 Determine the expectations and the variances of the esti- 
mates of correlation functions defined by one of the formulas 


Ri) = poe [xox + 2) at — 
Ral) = poe fo xt) — alate +) - ser, 


where X¥ = 1/(T — 7) | ae x(t) dt, if X(t) is a normal random function, 
46.5 The correlation function of the stationary stochastic process 


X(t) has the form 
K,(7) = o2e7!"!, 


Find the variance for the estimate of the expectation defined by the 
formula 


. it 
z -2f, x(t) dt. 


46.6 The spectral density S,(w) is found by a Fourier inversion 
of the approximate value of the correlation function. Determine 
D[S,(w)] as a function of w if 


i= > [ HOMOGE. 2S: 


the process is normal and, to solve the problem, one may use 
K,{7) = ae (1 + o|7]) 


instead of K,(7) in the final formula. 
46.7 The correlation function K,(r) determined from an experi- 
ment is used for finding the variance of the stationary solution of the 


differential equation 
Y(t) + 2¥(t) = X(t). 


Determine how a, will change if, instead of the expression 
K,(7) = o2e-%1"I(cos 0.757 + 0.28 sin 0.75|7|) 
representing a sufficiently exact approximation of K,(7), one uses 
Kir) = o2e~%!"| cos By, 


where «, and f; are chosen such that the position of the first zero and 
the ordinate of the first minimum of the expression of K;.(7) coincide 
with the corresponding quantities for K,(7). 
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46.8 Anapproximate value of K,(7) isused to find D[ Y(t)], where 


dX(t) 


Te a 


Determine how a, will change if instead of the expression 
KA) = ze 92°1"(cos 0.77 + ; sin 0.7Irl), 


which approximates quite accurately the expression K,(7), one uses 
Ki(t) = 02e-*” cos Br, 


where « and f are chosen such that the position of the first zeros and 
the value of the first minimum of the functions K,(r) and Kj.(r) coincide. 

46.9 The correlation function for the heel angle of a ship can be 
represented approximately in the form 

K,(r) = ae~*!(cos Brt+ 3sin Bil), 
where a = 36 deg.?, a = 0.05 sec.~! and B = 0.75 sec.7?. 

Determine D[X,(7)] for r = 0 and + = 3 sec. if O(t) is a normal 
random function and K,(r) is obtained by processing the recorded 
rolling of the ship during time 7 = 20 minutes. 

46.10 The ordinate of the estimate of the correlation function 
for 7 = Ois 100 cm.?, and for 7 = 7, = 4.19 sec. Its modulus attains a 
maximum, corresponding to a negative value of 41.5 cm.?. According 
to these data, select the analytic expression for K(7): 


(a) in the form K(r) = o?e-@'"\(cos Br + (a/B) sin B|r]), 
(b) in the form K(r) = 07e~*!"! cos Br. 


Determine the difference in the values of the first zeros of the 
functions K(r) in these two cases. 
46.11 Determine D[K,(7)] for + = 0, 2.09, 4.18 and 16.72 sec. if 


Z T-t 

K(or) = 7 | Ar)At + +r) dt, 
ae 

K,(r) = ae~*'"! cos Br, 


where a = 25 deg.?, a = 0.12 sec.~1, 8 = 0.75 sec.~! and O(t) is a 
normal random function, 8 = 0. To determine K,(r), one uses a 10 m. 
recording of @(t), where 1 cm. of the graph along the time axis 
corresponds to 1 sec. 

46.12 The graph of a sample function of the random function 
X(t) is recorded on a paper tape by using a conducting compound 
passing at constant speed between two contacts, one shifted with respect 
to the other by 7 seconds along the time axis. The contacts are connected 
to a relay system so that the relay turns on a stop watch when the 
ordinates of the sample function at the points where the contacts are 
located have the same sign and turns it off otherwise. Show that if 
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x = Oand X(t) is a normal stationary random function, the estimate of 
its normalized correlation function can be determined by the formula 


k(r) = cos n( _ 2), 


where /, is the total reading of the stop watch and ¢ is the total time the 


tape moves. 

46.13 Under the assumptions of the preceding problem, determine 
D[k(5)] if for the determination of k(5) one uses the graph of the 
sample function corresponding to the recording time T = 10 minutes, 


K(r) = eW ll, a = 0.2 sec." ?, 


46.14 Asa result of processing three sample functions of a single 
stationary random function X(t) for durations 7,, Tz and T3, three 
graphs of estimates of the correlation function were obtained. Assuming 
that the process is normal, derive the formula for finding the ordinates 
of the estimate of the correlation function K,,(7). Use all the experimental 
data with the condition that the variance of the error is minimal if for 
each sample function the estimate of the correlation function is given 
by the formula 


T 
Kz) = = {! x(t)x(t + r)dt, jf=1,2,3 (® =0). 
7 


46.15 Determine variance of the estimate for the correlation 
function of a normal stochastic process with zero expectation if to find 
K,(r) one takes the ordinates of the sample function of the random 
function during equal time intervals A, the duration of recording is 
T = mA and in the final formula K,(7) may be replaced by K,(7). 

46.16 The ordinates of a random function are determined by 
photographing the scale of an instrument during equal time intervals 
A = I sec. Determine the ratio of D[K(0)] to the variance obtained by 
processing the continuous graph of the sample function if 


K(r) = ae~5!"!, 


(7 is expressed in seconds), the process is normal and the observation 
time 7 = 5 minutes. 

46.17 An approximate determination of the ordinates of a sample 
function ofa stationary random function X(t) with zero expectation and 
a known correlation function K,,(7) is given by the formula 

2ajT =") 
SN 


X(t) = > (4, cos = + B, sin T 


7=0 


where A,, B; are mutually independent random variables with unit 
variances and zero expectations and 7 is a known number. Determine 
the constants a; so that 


7 if (kG = @Per= ine 
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where K,,(r) is the correlation function corresponding to the preceding 
approximate expression for X(t). Determine the magnitude of « for 
optimal values of the constants. 

46.18 To decrease the influence of the random vibration of the 
frame of a mirror-galvanometer used to measure a weak current, the 
readings are recorded during T = 10 sec. and the value j of the average 
recorded ordinate is considered to be the required intensity of the 
current. Find the mean error of the result if the vibration of the frame is 
described by the correlation function of the intensity of current J(f): 


Key See7""|, 


where 
a = 1071*4?, a = 1071sec.~?. 


ANSWERS AND SOLUTIONS 


I RANDOM EVENTS 


1. RELATIONS AMONG RANDOM EVENTS 


1.1 By definition AU A = A, AA =A. 1.2 The event A is a particular 
case of B. 13 B= Ag, C = As. 
1.4 (a) Acertain event U, (b) an impossible event V. 


1.5 (a) At least one book is taken, (b) at least one volume from each of 
the three complete works is taken, (c) one book from the first work or three books 
from the second, or one from the first and three from the second, (d) two volumes 
from the first and second works are taken, (e) at least one volume from the third 
work and one volume from the first work and three from the second, or one from 
the second and three from the first. 

1.6 The selected number ends with 5. 


1.7. A means that all items are good, B means that one or none of them is 
defective. 

1.8 Using the properties of events (BUB= B, BB=B, BUB=U, 
BU = B, BB = V, BU V = B), we get A = BC. 

1.9 (a) A means reaching the interior of the region S,, A means hitting the 
exterior of S,. Then A U B = U; that is, A = V, B= U. (b) AB means reaching 
the region S4z; common to S, and S,; A means falling outside S,. Then AB = V; 
that is) A = U, B= V. (c) AB means reaching the common region S43; AU B 
means hitting S4,U 2; Sag = Saug only if S, = Sg; that is, A = B, 

1.10 X= 28. 1.11 Use the equalities A = ABU AB, B = ABU AB. 

1.12 The equivalence is shown by passing to the complementary events. The 
equalities are proved by passage from ton + 1. 

1.13 No, since AU B = AB. 1.14 Use the equality 4 U B = AB. 

1.15 C means a tie. 1.16 C= A(B, VU B.), C= AV B,By. 

117 D= ABV BU Bs VU Ba(C, U Co), D= AU B,BLB3B,U C1 Cy. 

118 C= (A, U Ao)(Bi Be VU B, Bz VU BBs). 


2. A DIRECT METHOD FOR EVALUATING PROBABILITIES 


2.1 p=rm/n., 2.2 4/9. 2.3. p = 0.25 since the first card may belong 
to any suit. 2.4 1/65 ~ 0.00013. 2.55 23/240. 

2.6 The succession of draws under such conditions is immaterial and therefore 
p = 2/9. 
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2.7. One may consider that for control the items are taken from the total 
lot; p= (n—kK)/(n + m— k). 
2.8 One may consider one-digit numbers. (a) 0.2, (b) 0.4, (c) 0.04. 


2.9 (a) N= a+ 108. This condition is satisfied only if a is even and a + b 
is divisible by 9, p = 1/18, (b) N= a+ 105 + 100c. This number should be 
divisible by 4 and by 9; that is, a + b + cis divisible by 9, a + 26 is divisible by 
4(m = 22), p = 11/360. 





10:9-8-7-6 8-7!-3! _ 1 CG mae) 

2.10 Te-1~ 0.302. 2.11 To. 2.12 C2 = 14 
> 2 7 ClCkrs 
2.13 0.3. 2.14 (a) 3 (b) 9° (c) 3° 2.15 p= Che 


ie 
2.16 py = & (k = 1, 2,3, 4, 5), pi = 0.0556, po = 0.0025, ps = 0.85-10~4, 
90 
pa = 0.2:1075, ps = 0.2-1077. 


1n-1 
C2Can-2 _ n 








CeGne3. as | (as 1 





2.17 (a) Ch, oy = 1’ (b) 2 C3, = mod 
nm—m 1oigi 

218 p= Stem 249 p = AAC _ g o929. 
nt+k C32 


2.20 n= C3. = 7140. Thefavorablecombinations: (a) (7,7,7); (b) (9, 9, 3), 
(9, 6, 6); (c) (2, 8, 11), (2, 9, 10), (3, 7, 11), (3, 8, 10), (4, 6, 11), (4, 7, 10), (4, 8, 9), 
(6, 7, 8) and, therefore, m = 4 + 2-4-CZ + 4°-8 = 564; p = 0.079. 
CiCRCE C3C3 + C2Ch 7 

C3, => 0.75, (b) p= came cams = 74° 

2.22 It is necessary to get n — m nickels from 2m” buyers. The number of 
possible cases is C37"; p = 1 — (N/C3,™), where N is the number of cases when 
it is impossible to sell 2n tickets, N = D>?" Ni, Ni = C3ncam+1) is the number of 
cases in which the first nickel came from the (2m + 2)nd buyer, No = Cin "am+a) 
is the number of cases in which the first nickel came not later than from the 
(2m + 1)st buyer, and the second nickel from the (2m + 4)th buyer and so on; 


1 nm—m 
— 1 — FAnom Cc —1. 
Dp Ci, 2 21-1 


2.21 (a)p=1—- 





3. GEOMETRIC PROBABILITIES 
i 3 V3 
3.1 | ad: am 5 3.2 P= 95 ~ 0.316. 3.3 p=1—-> ® 0.134. 
3.4 Construction: AB is a segment of length 2h, C is the center of the disk. 
AD and BE are tangents to the disk, located on one side of the line AC. The tri- 
angles ADC and BEC coincide by rotation with angle gp = 7 DCE; therefore, 
Z.ACB = 9, h = I tan (p/2); p = (A/a) arctan (h/l). 


2r+d 2r+d 
3.5 p=1-(1- - J(r - ; ). 








3.6 (a) 0.0185, (b) p = ean = 0.076. 


3.7 (a) 0.16, (b) 0.6. 


3.8 x is the distance from the shore to the boat and y (with the corresponding 
sign) from the boat to the course of the ship. Possible values: x < 1-v; for » < 0, 
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x + y < 1-v, for y < 0|y| < x Wis the speed of the boat, 1 = 1 hour). The favor- 
able values: | y| < (1/3)v; p = 5/9. 


3.9 k(2 — k). 


3.10 x= AL, y= AM. Possible values: 0<x+y< J. The favorable 
values: |y — x| < x, p = 0.75. 


3.11 Two segments x, y. Possible values: 0 < x + y < I. Favorable values: 
x<l/2,y <1l/2,x+y 2 1/2; p = 1/4. 


3.12 Two arcs x, y. Possible values: 0 < (x + y) < 27R. Favorable values: 
x<mR,y <7R, x+y > 7R;p = 1/4. 


3.13 Segments x, y, z. Possible values: 0 < (x, y, z) < /. Favorable values: 
xtyezax+z2>yytz2>x;p = 1/2. 


3.14 AM = x, MN = y. Possible values: 0 < x + y < /. Favorable values: 
a, y<a,x+y21-—a. For 1/3 <a < 1/2, p= [1 — Ga/l)P; for 1/2 < 
Lp=1-—- 311 — @/DP. 

3.15 x is an arbitrary instant, 0 < x < 12 minutes. The instants of arrival 
of a bus belonging to line A: x = 0, 4, 8; the instants of arrival of a bus of line B: 
y, y + 6, where 0 < y < 4. (a) Favorable values: for 0 < y < 2, we have 
y<x<4,6+y <x < 12; for y > 2, we have y < x < 80ry+6<~x < 12; 
p = 2/3. (b) Favorable values: 2< x <4,6<x <8, 10<x<12,4+y< 
x <6+4+ y;fory < 2wehaveO0 < x < yandfory>2,y—2<x< y;p = 2/3. 


<< 
< 


3.16 x, y are the times of arrival of the ships. Possible values: 0 < x < 24, 
0 < y < 24. Favorable values: y — x < 1,x — y < 2;p = 0.121. 


t 2 

3.17 p=1-(1- 4). 
3.18 x is the distance from the shore to the first ship, and y the distance to 
the sécond ship. Possible values: 0 < (x, y) < L. The favorable region |x — y| < 


dV 1 + (v3/v;)? is obtained by passage to the relative motion (the first ship remains 
fixed and the second ship moves with speed v = ve — v1); for L = dv1 + (v/v1)?, 
p=1-[1 —-(@/Dv1 + @/o)?2; for L < dV1 + (v2/vs)*, p = 1. 

3.19 (a) p = 1 — (19/20)? = ee 2) x, y, z are the coordinates of the 


inflection points. Possible values: < (x, y, z) < 200. Favorable values: 
|x — y| < 10, |x — z| < 10, |y —2| < oe = 1 — (180/200)? = 0.271. 


_ 2nR*(1 — cos a) : 2g, 
3.20 p= ane = sin 
3.21 p= {x |” ie er {ar [" r cos p dp ay = 0.21. 


3.22 x is the distance from the midpoint of the needle to the nearest line and 
gy is the angle made by the ine with the needle. Possible values: 0 < x < L/2, 
0 < » < 7. Favorable values: x < (//2) sing, p = 21/L7. 
oe Possible values: |a| < 2, |b] < m. (a) Favorable values: b < a? 
For m = n?, 


. Wa fF ity cath in, SE 

pagtge | eda5 te 
For m < n’, 

1 [(* vm 

pei-se Vb db = aes 
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The roots will be positive if a < 0, b = 0. For m > n?, p = n?/12m; for m < n?, 
p = 1/4 — Vm/6n. (b) The roots of the equation will be real if 2 + a? < 0. The 
region for favorable values of the coefficients: @ < 0, b? < —a?. 
For n° < m?, 
nrle 


epithe | aia ge Oe 
P= 5m) 4 da = om 


For 7° > m?, 


ope en Pp os cedar, 
p35 ml, ? db = (1 — 0.6 = 


3.24 Let A and B be the positions of the moving point and the center of the 
circle, u and v their velocity vectors and r the distance AB. From the point B we 
construct a circle of radius R. We consider that 8 > O if the vector v lies to the left 
of the line AB, —7 < B < a. From the point A we construct tangents to the circle 
of radius R. The point A reaches the interior of the circle if the relative velocity 
vector falls into the resulting sector whose angle is 2e, « = arcsin (R/r). From A we 
construct the vector —v. Let O be the endpoint of this vector. From O we draw a 
circle whose radius coincides in magnitude with the velocity of the point A. The 
point A will lie in the circle only if the vector u — v lies in the sector. Let u > v. 
Then the required probability will be (Figure 41) p = «/27. To determine a, we set 
8 = ZOCA, x = ZOCD, y= ZODC, y= ZADO. Then « = 2e+ 6 -/y, 
Using the equalities 

sin y 3 sin (B — e) — sin 6 2 sin (8 + e) 
v u v u 





we obtain 
1 . v. ’ en 
p= on {2. + arcsin [? sin (B +e) — arcsin E sin (B aie, |}: 


The present formula is valid for any 8. For v > u, the problem may be solved 
similarly, but in this case one should consider several cases: (1) |8| > ¢ + (7/2), 
p = 0. (2) (7/2) + « < |B| > e: (a) for u < vsin(|B| — ©), we shall have p = 0, 
(b) for v sin(|B| — «) < u < vsin(|B| + «), we have 


= + arccos [: sin (|B| — o| ; 


FIGURE 41 
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(c) for wu > vsin (|| + «), we shall have 


Le + {arcoos |: sin (|B| — 0| — arccos E sin (|8| + |}. 
(3) |B| < e: (a) for uw < vsin(e — |B]), we shall have p = 1, (b) for 


vsin(e — |8/) <u < vsin(e + ||), 
we shall have 


1 v. 
p=1- = arccos E sin (e — 0) 


(c) for u > vsin(e + |B|), we shall have 
= 1 v, D3 
ae ee = {arccos E sin (e — i] + arccos E sin (e + he 


4. CONDITIONAL PROBABILITY. THE MULTIPLICATION THEOREM 
FOR PROBABILITIES 


nr 


41 p=1-03-0.2 = 0.94. 42 p=1-T]A-—py. 
k=1 
43 p= (1 — 0.2)? = 0.512. 4.4 0.251. 
45 p=1-(1— 031 — 0.22)= 0.328. 46 p(l — p)-?. 
4.7 1-05" >09;n> 4, 48 1 —(1— pt = 0.5, p = 0.159. 
ee 
49 p= (=) = 55g = 0.029. 


_ 1 1 1 1 1 216s : 


4.11 From the incompatibility of the events it follows that P(A | B) = 0 and 
P(B | A) = 0; that is, the events are dependent. 


4.12 piDz. 4.13 p = 0.7-0.912 = 0.197. 
4.14 p = 0.771 — 0.67) = 0.314. 4.15 0.75. 
4.16 p, = 0.9-0.8-0.7-0.9 = 0.45, po = 0.77-0.8 = 0.39. 
4.17 (a) 0,1 = (pips); that is, n = —1/(log p, log ps), 
(b) p = 1 — (1 — pipa)*(l — paps)’. 
4.18 It follows from the equality P(A)P(B | A) = P(B)P(A | B). 


2 2 
aaa p= 2(4)'[1 - )]. PO ee reas 


ji 63432!) = 30 
9 87 432 
421 (a) p=1- eg =03, (WD) pH1-~ F575 = 06. 
= _a@a=m!'a—h) 
822 PS Ga = 


! ! 399 
4.23 (a) p = 1 — 32997! 39,000! _ ( 


40,000! 38,997! ~ 


1 For solution see Yaglom, A. M., and Yaglom, J. M.: Challenging Mathematical 
Problems with Elementary Solutions. San Francisco, Holden-Day, Inc., 1964. Problem 92, 
p. 29 and solution to Problem 92, pp. 202-209. 
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(b) 0.5 > (40,000 — N)(39,999 — N)(39,998 — N) _ ((40,000 — ny 
aoe 40,000 - 39,999 - 39,998 saa 40,000 
N > 8,252. 
_ (100,000 — 170) (100,000 — 2-170) | 


at pe 100,000. (400,000 — 170) ~* 
(100,000 — 60-170 — 10-230) 
(100,000 — 59-170 — 10-230) 
_ (100,000 — 60-170 — 10-230) _ 
STi 700,000 = 0.125, 
(6) Peas = 1 — (100,000 — 5-170 — 230) (100,000 — 11-170 — 2-230) 
sup —_ TS Le eer FEA AAS... 4h on. "Soa 


(100,000 — 5-170) (100,000 — 11-170 — 230) 
(100,000 — 59-170 — 10-230) 

(100,000 — 59-170 — 9-230) 

1—p 
1 — Psup 


= 0.0246, 


(c) p= 1 — (1 — Psup)(1 — Pree), Pree = 1 — = 0.1029. 


4.25 P(A) = P(B) = P(C) = . 
P(A | B) = P(B| A) = P(C| A) = P(A|C) = P(B|C) = P(C| B) = > 
that is, the events are pairwise independent; 
P(4| BC) = P(B| AC) = P(C| AB) = 1, 
that is, the events are not independent in the set. 











4.26 No (see for example, Problem 4.25). 4.27 p=n!/n". 
4.28 p= ap ee! = Hy 

4.29 p= ate Co oo es l= a = 0.081. 

4.30 p= Ct GaGa, UG oa» e an 

4.32 p= Bee aee Ay, ~ 0.08. 


246 100 230°(501/? 


4.33 Let a), ao,..-., Qn be the buyers who have five-dollar bills and by, be, ..., 
b,, those with ten-dollar bills, and suppose that their numbers coincide with their 
order in the line. The event A, means that one will have to wait for change only 
because of buyer b, (kK = 1,2,...,™) 


m 


= g7,_ 2 _ @—-1) @-m+1)_n-m+1 
BS) LEAS Gat n (1-m+2) n+l 


4.34 It may be solved as one solves Problem 4.33; 








m 


2 = n—-2m+1 
P = ——___ = Bee ee ee, 
(Av) n— 2k +3 ps I] Po n+ 1 


4.35 The first ballot drawn should be cast for the first candidate. The proba- 
bility of this is n/(n + m). Then the ballots must follow in succession so that the 
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number of drawn votes cast for the first candidate is always not smaller than for the 
second one. The probability of this event is (2 — m)/n (see Problem 4.33); 
n (n—m)_n- m 


~ (+ m) n n+m 








P 


5, THE ADDITION THEOREM FOR PROBABILITIES 
5.1 0.03. 5.2 0.55. 5.3 pk = dt, pkj. 5.4 2r/R). 5.5 11/26. 


$6. pike 7a (Cfo + ChoCt + ChoCH + ChoC? 
x + CioC3C2 + CioC8) = 0.4. 
5.7 P(AB) = P(A) — P(AB). 
5.8 P(B) = P(AB) + P(AB) = [P(A) + P(A)]P(B| A) = P(B| A). 
5.9 P(B) = P(A) + P(BA) > P(A). 5.10 0.323. 5.11 0.5. 
5.12 npq™-?. 5.13. (a) 1/3, (b) 5/6. 
5.14 A means that the first ticket has equal sums, B the second ticket. 
(a) P(A U B) = 2P(A) = 0.1105; (b) P(4 U B) = 2P(A) — P(A) = 0.1075. 
5.15 From P(A v B) < 1, it follows that P(B) — P(AB) < P(A) or 
_ PA) _ato-1 
P(B) b 
5.16 From Z= XU, it follows that Z< X+|Y|, Z>X-|Y|, 
P(Z < 11) > P(X < 10 and |¥| <1) = P(X < 10) + P(\Y| < 1) — P(X < 10 
or |Y| < 1) 20.9 + 0.95 — 1 = 0.85, P(Z > 9) > 0.05, P(Z < 9) < 0.95. 
5.17 0.44 and 0.35. 5.18 p(2 — p). 
5.19 ps = 0.1 + 0.9-0.8-0.3 = 0.316; pe = 0.9(0.2 + 0.8-0.7-0.4) = 0.3816. 
1 1 1\ 1 n2>—-n+1 
5.20 pret (i- 3) 
5.21 pg ~ 0.8, po x 0.2. 
5.22 G(m +n) = G(m) + [1 — GQ) ]G(n| m); 
G(n + m) — Gm) 
1 — G(m) 


1 | 1 2 | 1 1 
PES DR gE ge ge 8 Sieg Pa pal pat = a, 


P(A | B) > 
n n(n — 1) _ 
G(n|m) = 


Another solution: py + po = 1, po = (1/2)pi; that is, p: = 2/3, pe = 1/3. 


1 1 . 4 2 1 
5.24 pi +pe+ps=1, po= 5 Pir Ps = 5 Pa Le, Pr = 7? P2 = at Pa: =a" 


7 
1 2 
32 = =. i =. 
5.25 pt+q=1,9=573 P=3 
m n+rm 
5.26 Bie > le Big ak P= oa 


5.27 p, is the probability of hitting for the first marksman; pis the probability 
of hitting for the second marksman; p; + po = 1,0.2p2 = 0.8-0.3p1; p = pi = 0.455. 


5.28 Use the condition of Problem 1.12. 
5.29 If we calculate the number of identical terms, we get 


P (U Ar) = C}P(A,) — C2P(A,A2) + C8P(41 4243) — ++ + (- Via 0 Ar). 
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5.30 Using the equality [|%., A, = >8-, A, from Problem 1.12 and the 
general formula for the probability of a sum of events, we obtain 


P(r Ax) = 1 - {2 PA) ~ "SS PAA) 
K=1 k=17=k+1 


HTS EB, pata + rre( ET aa) 


K=1j=k+14=74+1 


However, according to Problem 1.12 we have | Ji=1 Ax = Si_, A, and, hence, for 
any s, P([ [i=1 4x) = 1 — P(Xk=1 A,). Also considering the equality 
1-C, + GR ----+(-1)" = 0, 
we get the formula indicated in the assumption of the problem. 
5.31 Use the equality 


P(A. i As) 2 p(T] Ax) - p(T Ax) 
k=1 k=1 k=0 
and the formula from the condition of Problem 5.30. 


n —|jr-1 
5.32 p= > o. 
k=1 7 


5.33. The probability that m persons out of ” will occupy their seats is 
C™(n — m)/n! = 1/m!. The probability that the remaining ” — m persons will not 
sit in their seats is 





5.34 The event A; means that no passenger will enter the /th car, 


P(A;) = (1 - ‘). P(A;A)) = (1 = aie P(A,A:A3) = (1 - a 


and so on. Using the formula from the answer to Problem 5.29, we obtain 
k k <x k 
p=1- cx(i - ;] + a(t - *] ee (apie (i eel ‘) . 

n n n 


5.35 The first player wins in the following n cases: (1) in m games he loses no 
game, (2) in m games he loses one but wins the (m + 1)st game, (3) in m + 1 games 
he loses two, but wins the (m + 2)nd game,..., (”) in m + n — 2 games he loses 
n — 1 and, then, he wins the (m + n — 1)st game. 

P= p™(l + Cag + Ca+ig? +--++ Chtn-2g"7 7). 

5.36 The stack is divided in the ratio p,/p2 of probabilities of winning for the 
first and second players, 

1 1 


1 
P= me (+5 Cn + ean ae Bika) 
1 


p25 an (1+ 5 + = Gis ss Cry + a os = >m-1 Ca .) 





5.37 The event A means that the first told the truth, B means that the fourth 
told the truth; 
P(A)P(B | A) 

P(B) 
Let p, be the probability that (in view of double distortions) the Ath liar transmitted 
the correct information; p; = 1/3, po = 5/9, ps = 13/27, pa = 41/81, P(A) = pri, 
P(B | A) = ps, P(B) = pa; p = 13/41. 


p= P(A| B)= 
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5.38 We replace the convex contour by a polygon with a” sides. The event 
A means that line A,,; will be crossed by the ith and jth sides; A = >Pe1 Dai41 Ay, 
D = Dfa1 Daiti Px, Where pi; = P(Ai;); p’ = (1/2) Dh=1 De, Pe = DP =1 Pei — Pre 
being the probability that the parallel lines are crossed by the Ath side of length /,. 
From the solution of Buffon’s problem 3.22, it follows that pé = 2/,/L7; 
P = (i/L7) SR-, /,. Since this probability is independent of the number and size 
of the sides, we have p = s/L7. 


6. THE TOTAL PROBABILITY FORMULA 
1 2 7 


oat Mg be Ae, 6.2 eee a Se 
P72 11 12 W132 me AG, A he AB 
6.3. H, means that among the balls drawn there are no white balls, H2 means 
that one ball is white and H3 that both are white; 


eogl ts = oe ie : 
P 2 My + my Ng + Me 


6.4 Hy, means that a white ball is drawn from the jth urn; 


6.1 























P(741) = —_ k’ 
k 
P(A.) = m op ke 
_ m (m + 1) k m __m 
ey) Ce Gee) OED. Hee 
k 
P(A22) = m Ee k 
Consider 
m k 
P(Ha) = 2, P(A) = 
Then P(A;41,1) = m/(m + k). Therefore p = m/(m + k). 
6.5 0.7. 6.6 2/9. 6.7 0.225. 6.8 0.75. 6.9 0.332. 


6.10 The event A means getting a contact. The hypothesis H;, means that a 
contact is possible on the Ath band (k = 1, 2). Let x be the position of the center 
of the hole and y the point of application of the contact. 

P(7,) = Pd5 < x < 45) = 03, P(H2) = P(60 < x < 95) = 0.35. 
The contact is possible on the first band if for 25 < x < 35|x — y| < 5, for 
5 <x < 25, 20<y<x+5, for 35 <x < 45x —5 < y < 45. Thus 
P(A | H,) = 1/15. Similarly, P(A | He) = 1/14, p = 0.045. 

6.11 The event A means that s calls come during the time interval 2. The 
hypothesis H, (kK = 0,1,..., 5) means that during the first interval k calls came, 


P(H,,) = P.(k). The probability that s — k calls come during the second interval 
will be 


P(A | Hy.) = Ps — k), Pols) = oP PAkK)P(s — k). 
6.12 The hypothesis 4, means that there are k defective bulbs, P(H,) = 1/6 
(k = 0,1,..., 5). The event A means that all 100 bulbs are good, 
Cie Z 
eo 09% =k = 0,1,..., 5); 


Cidoo 


1 & 
p=z > P(A| Hy) & 0.78. 
k=0 





P(A | H,) = 
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6.13. The hypothesis H; means that there are & white balls in the urn 
(k = 0,1,..., 7); the event A means that a white ball will be drawn from the urn, 


1 k+1 n+2 
pea HONS Sa 2 Sq). 


6.14 The hypothesis H;, (k = 0, 1, 2,3) means that & new balls are taken for 
the first game. The event A means that three new balls are taken for the second game, 


CSCB-* C3 — x. 


, P Z 
Gig. RANE ea? 


P(,) = 





P(A) = 








p = 0.089. 
Gis = WG (9C2 + 8C3C? + 7C3) = 0.58. 


616 p= 25 24 (% 5 5 33) 24 190 


30 29 © \30 29 © 30:29) 28 203 


6.17 P(A) = P(AB) + P(AB) = P(B)P(A | B) + P(B)P(A| B). 
The equality is valid only in several particular cases: (a) A = V, (b) B= U 
(c) B= A, (d) B= A, (e) B = V, where U denotes a certain event and V an 
impossible one. 


6.18 By the formula from Example 6.2, it follows that m ~ 13, p ~ 0.67. 
6.19 In the first region there are eight helicopters, p ~ 0.74. 


7. COMPUTATION OF THE PROBABILITIES OF HYPOTHESES 
AFTER A TRIAL (BAYES’ FORMULA) 
0.1-5/6 = 
0.9:1/2 + 0.1-5/6 32 
7.3. The hypothesis A, means that the item is a standard one and Hz that it is 
nonstandard. The event A means that the item is found to be good; 
P(A) = 0.96, P(H2) = 0.04, P(A| Ai) = 0.98, P(A | Az) = 0.05, 
P(A) = 0.9428; p = P(H, | A) = 0.998. 
7.4 The hypotheses H; (k = 0,1,...,5) means that there are & defective 
items. The event A means that one defective item is drawn; 
P(H,)P(A | Hi). 


7.1 p= 


aie kama, + M)] | 
7.2 p=1: 2 + LGD) 


PH) = 2 P(A| He) = PCH | A) = 


P(A) 
The most probable hypothesis is H;; that is, there are five defective items. 
1 
7.5 P(H.| A) = 5078 = 0.214 (see Problem 6.12). 


7.6 The event 4 denotes the win of player D; the hypothesis H,, (k = 1, 2) 
means that the opponent was player B or C; 


P(H,) = S P(A | Hi) = 0.6 x 0.3 + (1 — 0.18) x 0.7 x 0.5; 
P(A | Hz) = 0.2 x 0.3 + (1 — 0.06)0.4 x 0.7; P(H, | A) = 0.59; 
P(H2 | A) = 0.41. 
7.7. The second group. 


7.8 The event A means that two marksmen score a hit, H;, means that the kth 
marksman fails; 


| 


p = P(H3| A) = 
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7.9 The event A means that the boar is killed by the second bullet; 
P(4) = > P(H,). 
k=1 
The hypothesis H,, means that the kth marksman hit (k = 1, 2, 3); 
P(A,) = 0.048, P(H2) = 0.128, P(H3) = 0.288, 
P(H,| A) = 0.103,  P(H2| A) = 0.277, P(g | A) = 0.620. 
7.10 The fourth part. TAL p=nk[(l + 2% +---4 nb), 


7.12 The events are: M, that the first twin is a boy, M, that the second is 
also a boy. The hypotheses are: H, that both are boys, H2 that there are a boy anda 
girl; 

2a 
l+a-—5b 

7.13 A, means that the kth child born is a boy and B,, that it is a girl (k = 1, 2); 
P(A, Ae) + P(B, Bz) + 2P(A,; Be) => 1, P(A, 42 + B, Bz) => 4P(4,B.). Therefore, 


2 1 1 
3 P(A,B2) = rg P(A; Ao) = 0.51 — 6° 


P(M) =a+5U-(a+5)]; p= P(M2|M,) = 


P(4,A2) + P(BiB2) = 


103 

153 

7.14 5/11. 7.15 One occurrence. 

7.16 Hypothesis H, means that the first student is a junior and Hz means that 


he is a sophomore. A denotes the event that the second student has been studying 
for more time than the first, B means that the second student is in the third year. 


p = P(42 | A\) = 














si Mg +n és 
PCH) =a P(H2) = —+> BA | iy BG HO ge 

1 

P(A) = G—apallne + 110) + mans], P(AB) = = =43 
1 1 
p = P(B| A) = one on 
1 
— Foes 


717 1/4 and 2/11. 


7.18 The hypotheses H,, (k = 0,1,..., 8) mean that eight out of & items are 
nondefective. A denotes the event that three out of four selected items are non- 
defective: 


PUH,) = 4; PUH,| A) = 0 (i = 0,1,2,8), 





9 
3 tl 
P(H;. | A) = CHEESE ( = 3,4,5,6,7), P(A) = 3 
8 
3 1 3 
p = P(Hs| A)-Z + P(Hs| A)-5 = 77° 


8. EVALUATION OF PROBABILITIES OF OCCURRENCE OF AN EVENT 
IN REPEATED INDEPENDENT TRIALS 


8.1 (a) 0.9% = 0.656, (b) 0.9* + 4-0.1:0.99 = 0.948, 
; 1. 63 


1 
8.2 (a) Cio 570 = 56? (b) 1 — 575 (1 + Cio + Cio + Cio + 1) = 


957 
1024 
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8.3 (a) p = C¥o0-0.019 0.99197 = 1.35072 = 0.18, (b) p & 0.09. 
8.4 0.17. 8.5 0.64. 8.6 (a) 0.163, (b) 0.353. 
8.7 p=1— (0.84 + 4-0.89-0.2 + 5-0.8%-0.22 + 2-0.8-0.2°) 0.72-0.6 = 0.718. 


88 W,= > capa" 7 ( = all = ( - a) 
m=0 w w 
8.9 p= 1 — (0.7* + 4-0.79-0.3-0.4) = 0.595. 


8.10 Hypothesis H, means the probability of hitting in one shot is 1/2, 
Hz means that this probability is 2/3. The event A means that !16 hits occurred. 
P(H, | 4) © 2P(Hz | A); that is, the first hypothesis is more probable. 


8.11 See Table 113. 


TABLE 113 












0.01 0.05 0.1 


0.0956 | 0.4013 |} 0.6513 











8.12 0.2. 8.13 0.73. 
8.14 Ray © 1 — e7 °°?" (x > 10). See Table 114. 


TABLE 114 





8.15 p = 1 — 0.95 = 0.4. 8.16 p= 1 -— 0.95 = 0.4). 
8.17 p = pio + 3p2o(ps + Pa) + 3pi0p3 = 0.0935. 
3.18 (a) p = P.4P3:% = 0.311, (b) 0.243. 8.19 0.488. 


8.20 A denotes the event that two good items are produced. The hypothesis 
H, means that the Ath worker produces the items (kK = 1, 2, 3); 


3 
p= 2, PU. | A) x P(A | Hy) © 0.22. 


8.21 (a)p= H = 0.794, (b) 3p* — 4p? + 5 = 0, p = 0.614. 

8.22 Py = p* + Capita + C2p*q? + C2p%q3(p? + 2p?q) = 0.723; Py = 0.277. 
1 

8.23 p= yank Chn-k- 8.24 0.784. 

8.25 The 200 w. ones (Re, = 0.394; Rio,2 = 0.117). 

8.26 0.64. 8.27 0.2816. 

8.28 Pp = nCkzip*q"-* for m > k; Pm =O form < k. 


2k-1 


2k-1 
= = I k-1,m-k 
8.29 p= i Pr np oe Cr-i@ ‘ 
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8.30 We require: 


ss n nin — 1)]. 
o1 zoel + 5+ IE n > 25. 


8.31 We require: 0.99-519 = 479 + Cto4® +--+ + Ch4?9-*3 n = 5, 
8.32 Paso = 0.3024, Pr = 0.4404, Pao = 0.2144, Py,3 = 0.0404, 
Pag = 0.0024. 


8.33 0.26. 8.34 0.159. 8.35 95/144. 8.36 n= 29. 
8.37 n> 10. 8.38 n> 16. 8.39 8. 8.40 8. 
8.41 p = 4; p = 0.251. 8.42 ps = 3, w- = 1; p = 32/81. 


9. THE MULTINOMIAL DISTRIBUTION. RECURSION FORMULAS. 
GENERATING FUNCTIONS 


9.1 p= Ps. 9,2,1 + 2Ps; 3,2,0 = 50/243. 
9.20 p = Paiijij1 + Ps:2,10 + Paz1,2,0 = 0.245. 





9! 1 9! 1 
10! 


94 p= 13! 0.15°0.223-0.13 = 0.13-1074. 


9.5 p=1 — 2(0.0664* + 5 0.25614 + 4-0.0664-0.2561° 


+ 6-0.06647-0.2561? + 4-0.2561 -0.0664*) = 0.983. 


12! 6! 12! 1 
9.6 (a) p= 76.612 = 0.00344, (b) p= 22121314! 62 = 0.138. 


fim™n™ 
9.7 (a) pr = G+ m+ natty? (b) p = 6, 


(c) = (, +m + ny)! Pim™ipn™ : 
P= Timinm! (U+tm+natmtn 


1 1 
9.8 D=Dn, Pe = Pe-1"5 + (1 - Pe-) 5 = 0.5; p=0.5. 


9.9 Let p, be’the probability of a tie when 2k resulting games have been played; 
Petr = (1/2)px (K = 0,1,...), Po = 1, Pa-1 = (1/2)"~ 73 p = (1/2) pn-1 = 1/2". 

9.10 The number x should be odd. Let p, be the probability that after 2k + 1 
games the play is not terminated; po = 1, 


5 i: Pee 1 1 3 (n-3)/2 
p= (3) («= 1,2... 5) ); P= 4 Prove = 3 (4) : 


9.11. Let p, be the probability of ruin of the first player when he has & dollars. 
According to the formula of total probability py = ppei1 + @px-1. Moreover, 
p+q=1, po=1, Patm = 0. Consequently, 9( pe — Pe-1) = P(Pe+1 — Px 
(1) p=q. Then py = 1 — ke, c = 1f(n + m); that is, px = m/(n+ m), pu = 
niin +m). (2) p #q. Then py — pe-1 = (p/g)"(pi1 — 1). Summing these equalities 
from 1 to n and from 1 to n + m, we obtain 





n nem 
1- (4) 1- (2) 

l1—-p,=(1- = 1 — praom=Q- 5 Fae 
P Py) ai Pn+ ( Py) - 


fis aot 


P P 
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au! 
Pi pu = 1-p: = ——¥4o.. 
be PG) 
Pp 
9.12 P= Pp; Pn = Oform <n; P, = 1/2"-1;P, = 1/2"forn < m < 2n - 1. 
In the general case P,, is determined from the recurrent formula 


1 1 1 
5 Pm-1 + 353 Pm-2 ea nai Pm-n+is 


which is obtained by the formula of total probability. In this case, the hypothesis 
H,, means that the first opponent of the winner wins k games; 


Pr = 


Pro’ = PUt)(5) CEN ae 


9.13 P, is the probability that exactly k games are necessary. For k = 1, 2, 3, 
4,5, P, =0, Pe = 2p® = 1/28, Pa = 2Ctp’g = 3/2°, Py = 2Ci pg? =.21/2", 
Py = 7/25, Py = 63/29; (a) R = Di, P, = 193/256, (b) if m is odd, then P, = 0. 
For even n, P, = (1/2) pin-12, Where p, is the probability that after 2k games the 
opponents have equal numbers of points; ps = CYo(1/2?° = 63/2°, pe+i = (1/2)px; 
that is, 


63 63 
pes ers = 5.6.00, Pa = games 


9.14 Expand (1 — u)~? into a series and find the coefficient of u”. 
9.15 The same as in Problem 9.14. 
9.16 The required probability is the constant term in the expansion of 
generating function 
_ 1 1\7 dd +4)", 1 
GW) = (w+ 247) Ss ame 8 P= ii on: 


9.17 The required probability is the sum of the coefficients of u raised to 
powers not less than m in the expansion of the function 


as ih cell 1\* + uy. 
ew (6 ta ag age ioat) = Guyer? 
1 4n 
eae Ck, 
p 4?" ,. an+m 


For n = m = 3, p = 0.073. 


9.18 The required probability is twice the sum of the coefficients of u* in the 
expansion of the function 


1 1 20 20-m 20! 
ee” fae = = ao“ M-—2NYQAO—M-TN., 
GW) = 520 (u+ i ree 3)" = = FH 2 2 aa wee ; 
1 8 316- 2k 
poo = 0.104. 


P= 23% 2 44h! ki6 — 2b)! 


9.19 (a) The required probability Ponamp is the sum of the coefficients of non- 
negative powers of u in the expansion of the function 
1 5) _ di +4) 


1 
5 G(u) = i utat?a ~ “qaapa? 





48 
Ponamp = a 2,, Cle = sar (28° + C28) = 0.5577, aspirant = 0.4423. 
k 
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(b) the probability of the complementary event is the sum of the coefficients of u 


whose powers range from — 4 to 3 in the expansion of the function 
23 


1qa+w4*. is 
G(u) => 420 = aot p= - 7, Ze Ck = 0.22, 
9.20 (a) The required probability P,, is found with the aid of the generating 
function 
_ 1 S B51 u(1 as u®)" 
G(u) = Gi (ut u + a ae Be SP 
- we obtain 


Using the equality 1/1 — w)" = 1 + CR-lu + CRyju? + 
Pa =a (CH — CaCaran + CaCniis —-°-), 
= >f@_, P,. Using the equality 


and the series is cut off if m — 6k <n; (b) R 
-+ Ctz}? = CZ, we obtain 


Ne a OF alee ae 
Ry = (Ch -— CACR-g + C2CR-22 — ++). 
For n = 10, m = 20, 
Poo = a (Cfy — CioCYs) = 0.0014, Roo = aa (C38 — ChC}) = 0.0029. 

9.21. The desired probability is the coefficient of uv?! in the expansion of the 

function 
| eee ae os st 
Gu) = jos 1 tu t +0) = R(T 


a (1 — Caul? + Cgu?° —---)( + Cau + C#u? +---); 


1 
9.22 (a) py is the coefficient of uw” in the expansion of the function 
1-—u 
ow = 2 (G4) 


=4 — CACHIA-1 + C2Chion-1 —- °°), 





Pr > m 
and the series is cut off when N — ms < n 


N 
(bt) palit py— 2 Pe=1 + pw pa (CH — CaCh-m + CRCH—om ~ °° 


(compare with Problem ae 
= (3 =“) , p= (Ca — 3) = 0.1875; 





9.23 (a) Gify) = 


“(1 + v)®, p =aC8 = 0.2461; 


1 10 2)3(] 12 
() GW) = GW x c_() Z a Cea a ea 


p= 353 (Ch + 3C%) = 0.1585. 


(6) Go) = 3 
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9.24 Hypothesis 4, means that the numbers of heads for the two coins first 
become equal after & tosses of both coins (k = 1, 2,..., ); the event A means that 
after n throws the numbers of heads become equal (previous equality is not excluded). 


P(A) = 3 P(HA)P(A| He), p= PH), P(A) = PCA| Ho), 
1 
P(A | H,) = ark Cin “ox: 
Consequently, C2, = D%=1 4°C3i*2,.P(H;). Using successful values for n, one can 


find p = P(A). Let R(u) = Yeu u“P(H,), Ou) = 2; 0 u’p;, where pp_; = P(A | Hj). 
Adding together the terms containing u", we obtain: 


O(u)R(u) = > ur 


n io) 


Pn-xP(Hx) = >. u®P,(A) = Qu) — 1; 


=1 


o k 
Olu) = > (3) QM! _ Gg _ y-w. 


k=1 





2o\4) GD? 
7 ee (Qk —2!  . - On= D1 
RW) =1—- Vi-u= 2 Woe ay P= GS TTA 


9.25 Let uw be the number of votes cast for a certain candidate. The probability 
of this is P, = C4p’q"~“*. The probability that at most uw votes are cast for this 
candidate is a, = >4%~» Ps. The probability that among k candidates / — | receive 
at least » votes, k — / — 1 persons get no more than p» votes and two receive pu 


votes each is 
k!} 


SS Dik Tayi (ht Pu ou) teak Pas 


p= ets > P2ak-'-1d. + Py, — a,)'~} 
2al-—D)!«kK -1-1)! a ** 7 ss : 
9.26 The probability of winning one point for the serving team is 2/3. 


1 2 2 13 +k 1 4 2 ll+k ] 6 2 9+k 
(a) Py = Cts (5) (3) + Cy_-iC?s (3) (5) + C2-1C#; (5) (5) 


1 2k-—2 2 17-k 1 2k 2 15-k 
tees orstctss (3)" "(G+ es (3) (5) 
5] 


Py = (5) 6* (4*-*Cis + 4*>?Ch-1Cis + 4*~8C2-1Cis +--- 
ne + 4Ci_,C¥5+ + Ch); 
Oi = (; (3 Gu (AY + AFCECIy + 4 PCRCE, ++ 
+ 4Ck-? Cia + Ch) 


or 


(k = 0,1,..., 13). 
The numbers P;, and Q, are given in Table 115. 


TABLE 115 






6 











0.01623 | 0.02260 






P;; 0.00228 | 0.00571 





































0.01047 0.02915 | 0.03546 
QO, | 0.00114 | 0.00342 | 0.00695 | 0.01159 | 0.01709 | 0.02312 | 0.02929 
k 7 8 9 10 12 13 
P,, 0.04118 | 0.04604 | 0.04986 | 0.05254 | 0.05407 | 0.05450 | 0.05392 


0.03524 | 0.04064 | 0.04525 | 0.04890 | 0.05148 | 0.05299 | 0.05345 
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13 13 
(b+) Pr= 2 P, = 0.47401, Q,= 3 Ox = 0.42056. 
k=0 k= 


(c) let a, be the probability of scoring 14 + & points out of 28 + 2k for the 
first team (serving), which wins the last ball, 8, being the analogous probability for 
the second team; 


1 2 2 26 1 4 2: 24 
Bo = Qis, a = Cis (5) (3) + CiCis (5) (3) or 
1 26 2. 2 1 28 
+ CisCi2 (5) (3) + (5) = 0.05198, 


Oea + Besa = 1 (G ts Bx), O41 Broa -_ ~5 (e = Bx)3 
that is, ; 
(oe, + Bi) = 5 (oo + Bo), (%, — Bx) = at (a9 — Bo); 


Oo + —1)* ao + —1)* 
Pr=> ot Po, OY (eo — Bo), ak = oF Po _ (OF (eo = als 


_ 0.10543 (—1)*0.00148 ae 0.10543  (— 1)*0.00148 | 


PR = Be +1 = geri > k Ret gk+1 ’ 














dbx = 0.05257, On = > ax = 0.05286; 
(0) P= Py + Py = 0.52658, Q = OQ. + Qn = 0.47342. 


oN 
Qa 
— 
» 
m 
II 


II RANDOM VARIABLES 


10. THE PROBABILITY DISTRIBUTION SERIES, THE DISTRIBUTION 
POLYGON AND THE DISTRIBUTION FUNCTION OF A 
DISCRETE RANDOM VARIABLE 


10.1 See Table 116. 
TABLE 116 











0 for x <0, 
F(x) = <0.7 for 0<x<1l, 
1 for x>1. 
10.2 See Table 117. 


TABLE 117 








2 3 


0.375 | 0.125 
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0 for x 
0.125 for O<x 
F(x) = ¢0.500 for 1 <x 
0.875 for 2<x 
1 for x 


“ 


“ 


VIA I IA IN 


WWwWN —& © 


10.3. See Table 118. 





10.4 (a) P(X = m) = q™"'p = 1/2", (b) one experiment. 


10.5 X, is the random number of throws for the basketball player who starts 
the throws and X, is the same for the second player; 


P(X, = m) = 0.6"-1-0.4" 
P(X2 = m) = 0.6"*1-.0.4"-2 
10.6 See Table 119. 


} for allm >= 1. 


TABLE 119 



















8 9 14 15 19 20 25 


0.008 | 0.036 | 0.060 | 0.054 | 0.180 | 0.027 | 0.150 | 0.135 | 0.225 























10.7 P(X = m) = q™~*p = 1/2"-8 for all m = 4, since the minimal random 
number of inclusions is four and occurs if the first device included ceases to operate. 


gq’ for m=0, 
gq -™) for O<m 


10.8 (a) P(x = m) = { E 
pq’: for 1l<me<n-l, 


(b) P(X = m) = { ¥ 
q’ for m=nhn., 
10.9 PCY = m) = Cfhp"q"-" for allO < m<n. 
10.10 PCXY = m) = 1 — 2-0.25" for all m 2 1. 
10.11) P(X =k) = (1 — p/w)*~4p/w for all k 2 1. 
10.12 P(X = m) = (np)"/m! e~” for all m > 0. 
10.13 See Table 120. 


TABLE 120 





ANSWERS AND SOLUTIONS 393 


10.14 See Table 121. 


TABLE 121 





11. THE DISTRIBUTION FUNCTION AND THE PROBABILITY DENSITY 
FUNCTION OF A CONTINUOUS RANDOM VARIABLE 


Il F(x) = \ v x belongs to (0, 1), 
0 if x does not belong to (0, 1). 
11.2 f(x) = ew, 11.3 24/%x, 





or 
11.4 (a) p= ,, (b) f() = - re. 





11.5 (a) o, (b) x, | 2282 log 2 ~ 1.180, (c) f(x) = se ~ «2/202 


11.6 (a) f(x) = a ae (x 20),  (b) xp = {—xoln (1 — p)}¥, 


@ (7 x)" 


t 
11.7 (a) 10, (b) F@®) = ae [ee dt, where tg = 
0 





log x — log Xo. 


V 20 is 
1 1 a 
11.8 @)a=5,b=-; (b) FO) = Tay am} 
a(pB —a 
(c) Pa < X < f) = * arctan ora eae 
11.9 a= =. 11.10 (a) F(x) =5 5+ * arctan x, (b) P(|X| < 1) = 5. 
7 
1 2 
IL11 p = 5. W112 p=: 


11.13 Introduce the random variable X denoting the time interval during 
which a tube ceases to operate. Write the differential equation for F(x) = P(X < x), 
the distribution function of the random variable X. The solution of this equation 
for x = /has the form F(/) = 1 — e~*. 





z— “ 


2 
11.4 (a) Fi (6L? — 8Lz + 3z%), (b)1— (3 —= 


11.5 f(x) = > l ; (x — xi). 
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12, NUMERICAL CHARACTERISTICS OF DISCRETE RANDOM 
VARIABLES 


12.1 x —p. 

12.2 xX, = 1.8, %, = 1.7, ¥2 = 2.0; the minimal number of weighings will be 
in the case of system (b). 

12.3. MLX] = 2, D[X) = 

12.4 To prove this it is necessary to compute M[X] = dG(u)/du|.-,, where 
Gu) = (qi. + pili)(g2 + poli)(gs + pat). 

12.5 We form the gencrating function G(u) = (q + pu)";MLX] = G’‘(1) = np. 


n 


De ne 
126 = > miky. 


t=1 

12.7 For the first, 7/11; for the second, —7/11 coins; that is, the game is lost 
by the second player. 

12.8 Consider a, b and c as the expected wins of players A, B and C under the 
assumption that A wins from B. For these quantities there obtain @ = (m/2) + (b/2), 
c = a/2, b = c/2, forming a system of equations for the unknowns a, b and c. 
Solving the system, we obtain a = (4/7)m, b = (1/7)m, c = (2/7)m. In the second case, 
we obtain for the players A, B and C, (5/14)m, (5/14)m, (2/7)m, respectively. 


2 4 5 7 8 
12.9 Mil = 3 + (H+) + (Ht pe) 


2 aa Mee 
- ma2 2” m=1 2" ae 2 4 7 98’ 
3 3m+1_3 1 48 
MO gt ptt Hal, 47 Ti 
8 
12.10 MLX] = p RL ~ pyet = F 





> 
de ti 
1211 M[X] =p 2 ml ~ pyrt = 4+ P= 34 
12.12 MX] = k/p; DLX] = [k(1 — p)/p). The series 
oe a = ad Bi 


is summed with the aid of the formula 


dk = k 
Sg 2 = Tg 
whereg = 1 — p. 
12.13. (a) M[m] = w, wherew = 1/(1 — e~%, (b) M[m] = » + 1. Forsum- 
mation of the series, we use the formulas 


-am Go see, 5 eh 1 ; 
> ie ~ da 2 . ~ da (; 3} 


me m=0 
12.14 M[X] = 1/lp. + pepa(l — p,)] = 4.55, where pi = 0.18, ps = py = 


0.22. 
12.15 MX] = 4(2/3). 12.16 M[n] = 21 + m dRa1 (1A). 


12.17 Find the maximum of the variance as a function of the probability 
of occurrence of an event. 
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12.18 ws = mp(1 — p)(1 — 2p) vanishes at p = 0, p = 0.5, and p = 

12.19 Treat the variance as a function of probability of occurrence of an 
event, 

12.20 In both cases the expected number of black balls in the second urn is 5, 
and of white balls is 4 + 1/2'° in the first case and 4 + e~° in the second case. 

12.21. Two dollars. 12.22 For p < 3/4. 

12.23 M[X] = [(n? — 1)/3n]a. For finding the probabilities p, = P(X = ka) 
that the random length of transition equals ka, use the formula of total probabilities 
and take as hypothesis A; the fact that the worker is at the ith machine. 

12.24 g = 0.9; Pio = 1 — @?° & 0.651. 12.25 MLX] = 3/2. 

12.26 M[X] = >Re: (1/n?) = 77/6. 12.27 y=1/2p; y = 6.5 dollars. 

12.28) M[X] = x/m; DLXY] = n(m + n)/m’. 

Bw + Mee ~ 5 3 


12.29 Xx => N+ AN; N ae N, + 


NN, 
limy-.0 X, = [((M + M,)/(N + NIN. Write the equation of finite differences for 
the expected number of white balls X;, contained in the first urn after k experiments: 


MiM 1 1 
Xe = Xx = a aes (5, + x) Xe 
1 





k a m-—k 
12.30 p= Ck (*) (" ‘) , X= m. D[X] = 


Wn nt n 

12.31 x = q/p; D[X] = q?/p? + q/p, where g = 1 — p. 

o. < (2n — 2)! —  (2n)! 

. M = — eee a Dae ee A = = 

12.32 M[X] = 2 2nps= 2 aom=aG7 = iyTP = 2p FIP = 
VY cpa, once 
2 (3) Gyro ne eee 








since 





13. NUMERICAL CHARACTERISTICS OF CONTINUOUS RANDOM 


VARIABLES 

: ‘ 
13.1 M[X] = a, D[X) = 7 Baa. 
13.2 M[X] = 0, D[X] = . 


13.3 M[X] = 2, PIX] = 5 (5 _ 1). 


eva 2 7 
a? a 
13.4 D[LX = Sas ae 
[X1=5, B= <, 


= = = > P(a <a) 0.544 
13.5 P < — 1 — ae P = nia ——— = 
(a < a) e (a>a) =e" ™4, Pla > a) ~ 0456 1.19. 
4h® 1/3 4 
13.6 A=— M[V — D = eee) Ue 
3 Va YI ae Iv] = 7 “) 


13.7. M[X] = DIX] =m +1. 
3 
13.8 M[X] = 5 0, D[X] = 3x8. 
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13.9 M[X] = 0, DLX] = 2. 
13.10 an 1 = D — p2 1). 
A Re] + 1 M[X] = (« + DB, DLX] = Be + I) 


r (a + d) 
Ta P(e)’ 


—_ ab —————————————— 7 
~ (a+ ba + 64 1) 





1311 4 MX] = —<, DIX] 





an 

13.12 4 = Ae, M[X] = 0, DLX] = 
Var r(5) 

To calculate the integral ff (1 + x?)""*»? dx, use the change of variables 


x= Vy — y) leading to the B-function and express the latter in terms of the 
T-function. 


1 
—— (n > 2). 


vir(3) 
13.13 4 SR, Die ret ee, 
ze-onp(2 *) 
2 
13.14 Use the relation 
dE) ..- all -FO)]. 
PONS ees oF 


13.15 M[T] = 1/y. Notice that p(t) is the distribution function of the random 
time of search (7) necessary to sight the ship. 


13.16 m(f) = moe”. Consider the fact that the probability of decay of any 


fixed atom during the time interval (t, ¢ + Ar) is pAt and work out the differential 
equation for m(f). 


13.17 Ty = (1/p)(log 2)/(log e). Use the solution of Problem 13.16. 


13.18 [P(7T < T)]/[P(T > T)] = 0.79; that is, the number of scientific workers 
who are older than the average age (among the scientific workers) is larger than 


that younger than the average age. The average age among the scientific workers is 
T = 41.25 years. 


_ Qv — Iv — 3)---5-3-1 7 
13.19 mo = @= 0D. =) = TGk= es aE for n > 2v + 1, may41 = 0. 


For the calculation of integrals of the form 


~ x? -(n+1) 
i (1 + =) ax, 
0 n 


make the change of variables x = Vnaly/( — y)] that leads to the B-function and 
express the latter in terms of the I’-function. 


_Twet+brp +9. 
poe, He PCE pe ae ke) 


2 
13.21. M[X] = 0, D[X] = 5 # 


NI 


13.22 py = ¥ (—1)*-4(8)*-!m,, where m, = M[X’]. 
j= 


k 
13.23 m, = > Ch(%)*~4u;, where wy = M[(X — x’). 
7=0 
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14. POISSON’S LAW 





4 
141 p=1—e-%! = 0.095. 14.2 p= mer ~ 0.17. 
143 p=1-—e 2% 0.63. 14.4 p=e-°5 x 0.61. 
14.5 (1) 0.95958, (2) 0.95963. 14.6 0.9. 14.7 0.143. 
1 2° 1 ts a 
148 p= A ees b= 2, mi © 0.08 
14.9 0.4. 14.10 sk = —L. 14.11 (a) Coy" e-*, (b) 1 — e7, 


Va 

14.12 M[Y] = DLXY] = (log 2)/(log e) MN./AT,. Work out the differential 
equation for the average number of particles at the instant ¢. Equate the average 
number of particles with half the initial number. The resulting equation enables 
one to find the probability of decay of a given particle; multiplying it by the number 
of particles, we get MLX’]. 

no 
14.13 (a) p= wai e~" = 1.02-:10-19, (b) p=1 -—e7" — ne" & 0.673, 


where 


_ MNoptS bad 
n= AeA 0.475. 


14.14 Express Pp(ki, ke,..., km, km+1) in the form 


(= 2)(- 54 
Pills Cos isos Kak) = 


(: 2 ae a ee “2 





where s = >7,k,. In as much as >f_, A, and s is finite, then 


n> @ - 1 i s 
A yay 
15. THE NORMAL DISTRIBUTION LAW 


15.1 p = 0.0536. 
15.2 Poelow = 0.1725, Pinside = 0.4846, Pabvove = 0.3429. 
15.3. (a) 1372 sq.m., (b) 0.4105. 15.4 22 measurements. 





15.5 E, = 2p,/? E, = 0.78Ey. 


15.6 See Table 122. 


TABLE 122 








x | -65 —55 | —45 | —35 25 Pi) 35 45 C5 eg! eas 


‘F(x)| 35 350 | 2,150 } 8,865 | 25,000 | 50,000 | 75,000 | 91,135 97,850 | 99,650 99,965 
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15.7. E x 39 m. The resulting transcendental equation may be more simply 
solved by a graphical method. 


15.8 £, = a [2 
7 


15.9 (a) 0.1587, 0.0228, 0.00135; (b) 0.3173, 0.0455, 0.0027. 


15.10 p x 0.089. 15.11 p = 0.25. 15.12 (a) 0.5196, (b) 0.1281. 
15.13. M[X)] = 3 items. 15.14 Not less than 30 u. 
15.15 ~8.6 km. 15.16 (a) 1.25mm., (b) 0.73 mm. 








15.17 (a) Fi(x) = for all x > 6, 











(b) Fe(x) = fora<x <b. 








b? — a? 
15.18 E= » fas . 


16. CHARACTERISTIC FUNCTIONS 

16.1 E(u) = q + pe’, where g = 1 — p. 

16.2 E(u) = it (gx + pre), where p, + qx = 1. 

16.3 E(u) = (q + pe)"; MLX] = np, D[X] = npg. 
ee aril =, 
1+ al — ey’ 
16.5 E(u) = exp {a(e™ — 1)}, MLX] = DLY] = a. 


16.4 E(u) = MX] = a, D[X] = a(l + a). 





2,2 
16.6 E(u) = exp (ius - SF ). 


16.7 E(w) = 7, m= ki! 


eid etue be x coy Ce a* +1 


Wb wm CEO Se. 
16.9 E(u) = 1+ vV7e~”[i — O(v)], where v = u/2h and 


16.8 E(u) = 


Integrate by parts and then use the formulas: 


—_ 


Va % = 
—" e-*(p), [ e~®** cos qx dx = Benene [2 
2 f) 2 Pp 


7 -~A 
16.10 EW) = (1 ~ 4)", my = AED FRY, 


I e~** sin 2px dx = 
ie} 


a 





? See Jahnke, E., and Emde, R.: Tables of Functions with Formulae and Curves. 
4th rev. ed. New York, Dover Publications, Inc., 1945. 
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1 {7 , ; 
16.11 E(u) = LY eros? dp = I,(au). Pass to polar coordinates and use 


one of the integral representations of the Bessel function.? 
16.12 E(u) = exp [ixu — a| uj. By a change of variables it is reduced to the 
ron a +o eixu 
E(u) = ewe [*" epg 
The integral in this formula is computed with the aid of the theory of residues, 
for which it is necessary to consider the integral 


izu 
a e 
- O55 az 
ajlz+a 


over a closed contour. For positive u the integration is performed over the semicircle 
(closed by a diameter) in the upper half-plane and for negative nm over a similar 
semicircle in the lower half-plane. 


u2 uo? 
16.13 E,(u) = exp {in + ax) — 5 worl, E(u) = exp {- 7) \. 


16.14 bon = o7*(2k _ 1)!, Baret+i = 0. 
a 





16.15 St (x) = ma? + x2) (the Cauchy law). 
e-* for x > 0, _ {0 for x > 0, 
POH: BOOS . for x < 0, fila) = ne ior X-<-0; 


Solve this with the aid of the theory of residues; consider separate the cases of 
positive and negative values of x. 


16.17 PCY = k) = 2-*, where & = 1,2,3,.... Expand the characteristic 
function in a series of powers of (1/2)e’" and use the analytic representation of the 
6-function given in the introduction to Section 11, p. 49. 


17. THE COMPUTATION OF THE TOTAL PROBABILITY AND THE 
PROBABILITY DENSITY IN TERMS OF CONDITIONAL 
PROBABILITY 

= b 0, 6, 
17.1 p= x=.) (in tan > In tan 3): 
17.2 Denoting the diameter of the circle by D and the interval between the 
points by /, we obtain 





p= 2 = 0.4375. 
17.3. p = 0.15 
1 ph E 
i (ee 
CoD E 2LpV 1 


<r Bef 0 ge 


+= (=) ¥ 0(3)| = 0.67. 


17.5 In both cases we get the same result, p; = po = 0.4. 


11.6 p=1- nit! 5 Joe ‘) ts (2 5 ate dz. 








400 ANSWERS AND SOLUTIONS 


17.7 F(w) = nf 73 FONSZ*°? FO) ane dy. 


17.8 p=1- ra ~ 0.712. 
+0 
17.9 p, = —*~—, where r, = i flO Fx — x0) dx. 
Drei a -@ 
My+t1 
1710" fla (my S ee ee 


(m +! 


III SYSTEMS OF RANDOM VARIABLES 


18. DISTRIBUTION LAWS AND NUMERICAL CHARACTERISTICS OF 
SYSTEMS OF RANDOM VARIABLES 


1 
18.1 f(x,y) = {8 — a(d — ¢) 


0 outside the rectangle, 


fora<x<b,c<xye«xd, 


F(X, y) = Fi(x) Fey), where 








1 for x = b, 1 for y 2 d, 
Fiu(x) = a fora<x <b, FoCy) = *— forc <y<d, 
0 for x < a, 0 for y<c. 


x 


18.2 (a) A=20, (b) F(x, y) = (2 arctan 4 + 5)(= arctan % + 3): 


18.3 f(x, y, z) = abce~(a%* by +c), 
18.4 The triangle with vertices having coordinates: 


1, abc : 1, abe ,\. 1, abe 
(ZnB 0, 0); (0, gin, 0); (0, 0, £ in 2) 


18.5 (a) FG,j) = P(X <i, Y< jf) = PCX¥ <i-1, Y<j-— 1). 
For the values of F(i, /) see Table 123. 


TABLE 123 






0.623 | 0.627 





1 0.202 | 0.475 0.834 | 0.877 | 0.887 
2 0.202 | 0.475 0.908 | 0.964 | 0.982 
3 0.911 | 0.971 | 1.000 


0.202 | 0.475 


(b) 1 — P(X <6, Y <1) =1 — 0.887 = 0.113; 
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(c) M[X] = 


18.6 


18.7 


18.8 


18.9 


18.10 
18.11 


1.947; M[Y] = 0.504; |k,|| = 








2.610 ne 
0.561 0.548 


F(x) Xa, %) = TL RGD = FY |” G0 dbs 
pa flue) 


~ flu, v) + £, w) 


P= flu, v, w) [fF v, w) + fu, w, v) + fe, 4, W) 


+ fv, w, u) + f(w, u,v) + fC, v, w)]. 


P = F(a, b3) — F(ai, bs) + F(az, b:) — F(a, b3) + Flas, 4) 


— F(asa, bz) + F(aa, b2) — F(a, b4) + F(as, bs) — Flas, bi). 


P=a%*-—a*—aqa-%*+aq72 


2 
x for O< Rb, 
R2 
Zab % ~ 2B + sin 28) for b< Ra, 

: oO 
XX ( — 2x ~ 2B + sin 2a + sin 28) for a< R< Va? +B, 
1 for R> Va? + B, 


where « = arc cos (a/R), 8 = arc cos (6/R). 


18.12 


18.13 


18.14 


18.15 


18.16 


18.17 


18.18 


18.19 


3 3a 2a 
@c=—e, We= H(i - 3): 


_ {+1 for n/m < 0, Ox _ | 
(a) oe for n/m > 0, OG m 








Consider the expectations of the squares of the expressions 
ao, X¥ — X)+0.(¥Y — y) and o,(X — x) — 4o,(Y — 7). 
Make use of the reaction k,, = M[XY] — xy. 
1 —0.5 0.5 
Iry] = |} —0.5 1 —0.5 ||. 
0.5 —0.5 1 
(a) M[X]) =e+y=0.5, 
(b) M[Y] = «+ B = 0.45, 
D[LX] = (« + y)\(B + 8) = 0.25; 


D[Y] = ( + Pv + 4) = 0.2475; 
key = MLYY] — MLYIM[Y] = « — (2 + y\(@ + B) = 0.175. 
5 (0 
M[X] = M[Y] = 0; |A,|, = ' 
2 
I(x, y) = cos x cos y; MLX] = M[Y] =5- 1; 
aw—3 0 
val =[">° of 
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18.20 p aes 2 E = iE — Be + Farecos 4] 


18.21 p 12a ipsa 


. Use the formula P(A U B) = P(A) + P(d) — P(AB), where the event A 


means that the needle crosses the side a and B that it crosses side b. 


19. 


THE NORMAL DISTRIBUTION LAW IN THE PLANE AND IN SPACE. 
THE MULTIDIMENSIONAL NORMAL DISTRIBUTION 


19.1 F(x, y) = ; : rt o(* =)| : ba aE a 

















1 
19,2 x,y = = 
By) 1827-V3 
_2[@ — 26)? | @ — 26)(y + 12) | (y + 12)’ 
. exp { 3 196+ 182 + 169 
0.132 ~—0.026 
19.3 (a = 1.39, (b) |/A,|| = : Se = 0.162. 
(a) ¢ ©) lest =|] _Gooe ors pO % 
1 
19.4 2,2) = = = 0.00560. 
FQ, 2) Ime? V2 
1 
19.5 T(x, OP es —————— 
ae) 2a V 2307 
x exp {-35 (39x? + 36y? + 2627 — 44xy + 36xz — 3872) | 
1 
nax > OO = 0.00595. 
: 2a V 2307 
19.6 
2 -1 0 0 0 0 
—1 2 -1 0 0 0 
0 -1 2 —-i 0 0 
(a) ||Ao?|| = 0 oO -1 | 0}; 
0 0 Oo -1 2 
| 0 0 0 0 0 1 
1 nr 
exp _) > (1 - maa} 
(b) f(a, «6, Xn) = “Gny , where xo = 0. 
19.7 
10 0 2 0 
0 10 0 2 
[kis] = ; 
2 0 10 0 
0 2 0 10 


1 5 1 
F (1) Vas Xa, Ya) = FRqre EXP {- (xi + y? + x2 + y3) + ag (X1%2 + nya} 
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19.8 P(k) = 1 — e7**2, 19.9 P(k) = O(%) —- are eae 
TT 


p2R2/E2 oe 
19.10 P(R) = e777 1E?) i 1o(224) e-' dt, 


0 
where Jo(x) is the Bessel function of an imaginary argument. 


19.11 (a) P(X < Y)= * (b) PLY < 0, Y>O)=-5 


19.12 P= j |o() 7 o(2 =) |o() = a(? =) = 0.0335. 
19.13 (a) Pero = 1 — e79? = 0.2035, (b) Pog = [o()]' = 0.2030, 


(c) Pin = o(SH)a(4e 


19.14 P= 0.5(1 = exp {- p Fh). 
ae _ 92 Ril _ _ 92 Ra\\. 
19.15 P= on (exp { p ms} exp { p* 3 


_ 2 2p?d? ee 2p?k? 
19.16 A= 4dk, a= E/14 “3Ez° B= E. 3E2 














= 0.1411. 





o [d\ » [k ald k . 
19.17 P= o(4)o(§) < o(Z)o(), since « > E,,B > E,. 


19.18 Psa, = 1 — 9g? — 3q2(1 — g) — 3q[(p2 + ps)? + 2p2ps] — p2 = 0.379, 
Pexcei aa ps + 3p2(Ps + Pa) + 3p ps = 0.007, 
where pz = 0.196, ps = 0.198, pz = 0.148, ps = 0.055, g = 0.403. 


19.19 P= 5 (dF. 


19.20 P= o(Z) é 20%. exp { - F Eh - | (Z al 
wat (@) r= 05(1— e{-o"F}) [Ge Empa) + (one ma) 
(b) P= a (1 - exp {-p* Eh). 


* # 22 1 R272 
19.22 P= 0.5| (2) Bi (Vee Re). 
VhPE? + Ra? Ea 


a 
19.23 25(x,; — 10)? + 36(x; — 10)(x2 — 10) + 36(x2 — 10)? = 7484.6. 
19.24 16(x; — 2)? + 5x2 + 16(xg + 2)? + 8(x1 — 2)(xa + 2) = 8085.1. 





la 2 n 
ae lap ae ee a. fs 
19.25 Z (% — Xi-1) (eee 5 5 log en] 


The problem has no solution for 2 > 12. 
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20. DISTRIBUTION LAWS OF SUBSYSTEMS OF CONTINUOUS RANDOM 
VARIABLES AND CONDITIONAL DISTRIBUTION LAWS 


20.1 
1 for a, < x < a, b, < y € bo, 
T(x, Y, Z) = < (G2 — arl(b2 — by)(c2 — €1) C1 <Z< 2, 
0 outside the parallelepiped; 


1 
SO, 2) = <(b2 — bi)(c2 — 1) 
0 outside the triangle; 


for b, < y < be, cy S Z < fa, 


1 for ¢, < Z € Ca, 
f(z) = <€2— C1 outside the interval. The random variables 
X, Y, Z are independent. 





0 
20.2 For |x| < R, || 


< Rk, 
flay = RE py = RE. 
x x? 1 
F(x) = 2 | aresin 3 += a — *| + 7 
y 1 


_! Yad sell see alg 
F,(y) = = * [aresin 2 + 2 fh 2| + 73 
X and Y are independent, since f(x, y) # f(x) f(y). 


20.3 
1 


S$ for |x < R, 
2V R? — x? | 


f(y |x) = 518 + R) + 8(y — R)] for |x| = R, 


0 for |x| > R, 
5(z) being the 6-function. 
20.4 
#0 
lkyl| = 2 ; X and Y are uncorrelated. 
ye 


inside the square, 
20.5 (a) f(x,y) = 44 ‘ 
0 outside the square. Inside the square; 


= 2\x| av2 — 2K yl, 
- » Aly) = a 

1 i. 
(c) f(y | x) ~ VE = al’ f(x|y = avd — Api’ 


(d) DLY] = D[¥] = £, 


poe. 


(e) the random variables XY and Y are dependent but uncorrelated. 
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- 20.6 f(z) = (3(R? — 22)/4R°] for |z| < R, f(x, y|z) = I/[a(R? — 2?)] for 
z| < R. 

20.7 k = 4, f(x) = 2xe~** (x > 0), AC) = 2ve7? (y = 0), f(x |») = FC), 
f(y |») = AQ), M[X] = M[Y] = V7/2, D[X] = D[Y] = 1 — 7/4, kay = 0. 


208 MUX] = |" MLX| 9160) dy 


DEX] = {" DEX] 1G) dy + [" & - MEX] yD) wy. 


20.9 Since M[LX] = 5, M[Y] = —2, o, = 0, o, = 20, r = —0.8, it follows 
that: (a) M[X]| y] = 5 — 0.8/2(y + 2) = 4.2 — 0.4y, M[Y| x] = —2 -— 08 x 
2(x — 5) = 6 — 1.6x, ox), = 0.60, oy), = 1.20, 








(e=-5)? 1 (y + 2)? 
(b) fx) = = exp {-S"1., fu) = PEs exp { -2 I. 
_ _@ + 0.4y — 4.2)? 
CIR soa exp { aap 
(y + 1.6x — 6)? 
fol) = 7 exp {Ce} 


_ , fa ae a AE f ae 
20.10 f(x) = A,[Zexp{ -(« - a) }, ity) =A aoxP (« _ a) . 
For the independence of X and Y it is necessary that 
V ac b? [x2 Axy oy? 
wo exp {~5 (= oie aes *)} are 
This condition is satisfied for b = 0. In this case A = Vae/n. 


= 3V3 ~ 1 a: ~ (2x +1,5y)2 
DOAN foe Me agi LY) = apne 


f(y |) = See 08, 











va 

20.12 (a) f(x) = a? {- “Sage 
) 40) = been ah, 
() f(x | 0) = soo {- “Sag } 
(4) Sy | 25) = agree exp ee 


20.13 MLX | 2 = 0.8 + 149, M[Y | x] = 0.45x — 86.25. 
20.14 f(r) = ex {- rah 7 = M(R) = 7%. 
am PY 2a? Von 


mis 10 oo(-5 (b+ Bole (-4))} 


where /o(x) is the Bessel function of zero order of an imaginary argument; 


cos? sin? =A, 
fol) = [2720 ae # re) : 
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r? (cos? p , sin? £) 
(5 (Sa? + SF) 
re 1 
f@ |) =—Fa x { - 4% 20( = - x) 
anol mea) 


4 
r? sin 3 r? (cos? & cos? p 
(ny? abe *P 12 a? 
cos? #sin?@m — sin? d 
ak ee G 


2 sin # r? (sin? J 1 \ cos? # 
6.8) = ee on {5 (Bae + (Ge +) Se} 


r2 cos? # {1 1 
rn Ce 
sin? (cos? cos?@  cos*#sin?g sin? °) =a 
LO Ok = 47abc ( a? zs b? +3 
— cos? #cos?p  cos?#sin?g sin? #\3/? 
Se pg a oe aa 
a? ig c 


wee ee. (euweers = cos? & sin? p “i sin? “i, 


a b? c? 
2 
exp —*~ cos? § cos 29 ele — a 
4 a b 
I1GL iL). = See 


r? cos? } [1 ] 
rot (a - 8 














sine 
20.16 f(r| 9) = (ee + cage =| exp 


20.17 (a) f(r, 3,~) = 

















(c) f(r | 8p) = 











1 1 
20.18 fe, .9(%1, X2) = Face {~5 (5x? — 2x1xX_2 + sx}, 
1 x? + y? 
frecg (Xa y= a0 {- S 20 i}. 


20.19 f(X2, ye | 0, 10) = a sen"? 1-3 % [xz + (2 — 2)? i. 


M[X, | 0, 10] = 0, ae | 0, 10] = 2, 
D[X, | 0, 10] = D[¥, | 0, 10] = 9.6. 


IV NUMERICAL CHARACTERISTICS AND 


DISTRIBUTION LAWS OF FUNCTIONS OF 
RANDOM VARIABLES 


21. NUMERICAL CHARACTERISTICS OF FUNCTIONS OF RANDOM 
VARIABLES 


21.1 4a/z. 21.2 n(a/2). 21.3 M[G] = 4.1g., D[G] = 0.32 g?. 


21.4 M[o] = eC eae ee 
3 gy] = arc ho 3 Bp 
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21.5 40/mcm. 21.6 M[Y] =1. 21.7 115m. 21.8 a2/2. 
21.9 (n — 2)pq? (for n > 3). 21.10 M[R] = ay. 

21.11 11a2/187. 21.12 3/7. 21.13 Aa. 21.14 2 Des 
21.15 aft = (1 = zy"). 21.16 nfl — (1 — p)”). 


21.17 ¢= T7[l — exp{—a(l — e~°)}], 
5 = kT*[1 — 2exp{—a(1 — e~%} + exp{—a(l — e72%}]?. 
_(, — 2)" See ep emene ame al 
21.18 aft (1 2) + 2 (n il ( — :) | Peo. 
Where P@(k) is the probability that after the first series of cycles exactly & units will 
be damaged at least once; 


Prk) = cS (-1ye8|1 - ne" 


nA 


21.19 (a) mp + Som — 2k)p + kl — (1 — p)?]}Pr(A) + PRS) 


x [31> py? — 20 = pry + 2P76) 
<= t= pyr] + POS Ct pF, 
where Pr(k) = C,p*(1 — p)"-* forn = m = 8, 
(b) 2mp for n > 2m. 
a, b+ Vae+ Bh? bat Va+b? 1 


pias ors ee eae pul Mo Se oe = Vq2 2 
21.20 ep in - + 6q 2 5 + 3 va +b 
2 2 2 2 _ 3 
aien ap Pa 
a b 3a 3a 
21d, pes pal =p. 21.23 0.316g. 21.24 1/3; 12/18. 
k=1 k=1 


21.25 M[Z] = 5a; D[Z] = 100a? + 2256? — 150ab. 





E = (3 *) 
21.26) MiY)=]== DIvTS = (22) 
(Y] = “je. DIV = (3-5 


21.27 M[Y] = exp {—x(1 — cos b)} cos (* sin 5), 
D[Y] = ; [1 + exp {—x(1 — cos 26)} cos (x sin 2b)] — »?. 


21.28 (a) 26.7 sq.m., (b) 22.0sq.m., (c) 10sq. m. 


21.29 M[Z] = 2 |? ange Vz, D[Z] = a°(3 — =) + 
7 2p T 
21.30 M[Z] = 5(V3 — 1), D[Z] = 7600. 


21.31 rey = nt!/V(2n — 2)!1, if n is even; r,y = 0 if n is odd. 


E2 
Ap® (4 = 7). 


2a 1 4 
= a 2,2 ee ) (alee [ee 
21.32 M[Z] = 0, D[Z] = 2A2o?. 21.33 3 4 (5 4) 
a’e? e? ; this 
21.34 r= a( 1 + S), D[R] = aa (1 _ 5) (where e is the eccentricity). 
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22. THE DISTRIBUTION LAWS OF FUNCTIONS OF RANDOM 
VARIABLES 


22.1 





F.(2 = *) for a> 0, 
F,(y) = 





1— F(2=*) for a < 0. 
22.2 fly) = flee’. 











22.3 
1 z 
—=— exp< —~—5> forz>0, 
fz) = oV 2naz { rast} 
0 for z <0. 
22.4 ( 
ara eee {-o"(B) } 
= exp < —p?*(= for y 20, 
Koy =4 Eva OP NE 
0 for y < 0. 
22.5 
= or ks <y< 2 aie n 
sin ry ne ae are 
fy) = 
1 2 
0 for y < = or y > —arctane. 
2 7 
22.6 


] 
eee, 3, 
TOE i meee 
0 forv <O0orv> a. 
22.7 fa) = 2p 


22.8 





T= === for |»| < a (the arcsine law 
fo) =| Var 
0 for |»| > a. 

1 
22.9 (a) f(y) = 3nfl +d — 710 — py 


(b) if a > 0, then 


Va f 6 
——— for y20, 
Sy) = ma + y)Vy 4 
0 for y < QO; 
if a < 0, then 
—Va fax witha 
———— Or S 
LAY) = 4 ala + y)Vy - : 
0 for y > 0; 
(c) 
— for |y| < = 
LAY) = 
O for |y| > 3 
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22.10 For an odd n, 
ayGin— 1 
f(y) = ana? + y2")? 
for even n, 
Zaytiny-1 
fy) = § ana? + y?!") 
0 for-y <0. 


22.11 (a) £0) = |yle"’” (-o < y <a), 


() £0) = ee ee 


for y > 0, 


for y 2 0, 
for y < O. 
22.12 

Tek +1. 5) okra 


Vater - 


y for |y| < a 

Say) = 
oz 
2 


0 for |y| > 








2213 (@) LO) = yer {—F}, Ho) = ee ew {-2 Ph. 
22.14 


for O< yl, 


IAy) = {5 ere ad 


22.16 f(z) = WE exp {73}. where o2 = o2 + of. 

22.17 (a) fz) = [ "2 f(* :) dx — Ie : r(x z) dx 
(b) fe) = Fexp{-lz), © L£@=5 
(@) £4) = = exw { -5}. 


22.18 (a) fi(z) = E aa | eres 








0) LO) = qa 


(1 + z*)~%+2/2 (Student’s distribution law), 





(c) F(Z) = 


0,0yV1 — r? 


fe = 
z? — 2rzoxo, + 02)’ A 


@ f@) = Ta 


SZ) = (Cauchy’s distribution law). 
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T 


WS = 


ll 


22.19 (a) f(r) =r 


= Gs Vr? — x?) + f(x, —VrPF = x? x*)] dx 





a 
r (i f(r cos y, r sin y) dp; 


b 2 
(©) Oe 2p exp {—p (z) } forO<r<o, 


0 for r < 0; 


2r 
= forO<r<a, 


8 


(c) fir) = 


O forr>aorr<Q0O; 


r r? + hh? rh 
(d) fi) = Zexp {thi ( 4), 
where J(z) is the Bessel function of zero order of imaginary argument; 
Fr r(oxz + 94) |, [rok — 9%) 
(e—) f(r) = aa, exp { 4o202 Io 4o203 
22.20 U=(X — x)cosa + (Y — jy)sinag; 
V = (X — x)sina + (Y — jy) cosa; tan 2a = 2 Pee 


a Oy 





o2 = o2 cos? + of sin? a + roxo, sin 2; 


o2 = o2 sin? « + 02 cos? a — ro,o, sin 2a(o2 + of = of + 9%). 


22.21 
1 
—(2 — |«|) for |je| < 2 
Salo) = al | 
0 for |a| > 2; 
la |8| for |B| <1 
f:(8) = 2 


0 for || > 1. 


_ t t?(1 — rey sin 2¢) 
22.22 S(t, 9) = Wav] = ry exp { - 2(1 = r2,) 


For rxy = 0, ® is uniformly distributed in the interval (0,27) and the random 
variable T obeys a Rayleigh distribution law. 





22.23 f(s | t) is the probability density of a normal distribution with parameters 


2 


_t 
M[S | 1] = 50 + Dol + a5; 


t* 
D[S| 1] = D[So] + ¢?D[Vo] + rr Dia] + 2tksyug + f?Kspa + f2kuga- 


n n{2 
ke as ny? | 
22.24 LAY) = (2) y’~* exp {- Ge 202 f 





ANSWERS AND SOLUTIONS 411 


The characteristic function of the random variable X} if o? = 1, x; = Ois E,,(t) = 
(1 — 2t)~+/?. Then, the characteristic function of the random variable U = >?., X? 
will be E(t) = (1 — 2£)-"/* and the probability density 


f(U) = x | et] — 24)- "2 dt = = i yrl2)—1g- ul, 


n ni2 
ree 
If the random variables X; have the same variance o? and x, = 0, then the random 
variable 
aU 
n 
Consequently, f(y) = fulb(y)]|¥’()|, where $(y) = y?n/o?. 


r™~1 cos"~? m, cos"~ 9 ma: + -COS Pn-2 , 
(27r)"!20" 


Y=+ 


-12j2¢2 


22.25 f(r, Pls P2, +--+ @n-1) = 
22.26 fy(V1, Yas ++ -s Yn) = fA 2 Dg Vy wary anys) IAI, A= lauy| : 


22 
22.27 f(r, 3) = r? cosé i f(r cos # cos g, r cos # sin g, r sin ¥) dp. 
oO 


23. THE CHARACTERISTIC FUNCTIONS OF SYSTEMS AND FUNCTIONS 
OF RANDOM VARIABLES 


23.1 Make use of the fact that for independent random variables 


I (%1, X2,.- +, Xn) = TI fe). 


nh 
23.2) Ba) = be oc (Uo Os 23.3 E,(u) = e° Ti. Exz,(At) « 
23.4 E,(u) = (1 — 2iuo2)- 1/2; m, = M[Y’] = 1-3-5---(Qr — 1)o?’. 
etuta + b) ~~. etud 
23.5 E(u) = ees as 7 


23.6 E,(u) = (1 + iw; m, = M[Y'] = (-1)7! 

23.7 E,(u) = Jo(au), where Jo(x) = (1/27) [>” e'* °°5° dp is the Bessel function 
of first kind of zero order; 
1 


Sy) = P Jo(au) cos uy du = SS 
—- 2 T a =D 


1 
23.8 E,,,(ui, u2) = exp {iczus + Jus) — 5 (iui + 2orogrusu, + ofud)}. 


23.9 Pees age pen yy Ua, ++ +5 Un) 


nr o n n=l 
= exp {ai > Um — > > ur — ao? = tintin}. 


m=1 


ne + 1) _ n@n* + WD) ol. 


23.10 £E,(u) = exp {is ra 


23.11 M[(X? — 02)(X2 — o%)] = 2k2o. 
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23.12 (a) M[X2.X2X3] = 8kiokiskog + 207(k2o + k?3 + kB) + O°,” 
(b) M[(X7 — 0?)(X2 — 0?)(X3 — 07)] = 8kiskiskas. 

23.13 M[X,X,X3] = 0. 

23.14 M[X,X2X3X4] = kiokas + kiskos + kiskoa- 


23.15 For the proof, make use of the expansion of the characteristic function 


1 n n 
Ex xa xn (U1, U2,..+, Un) = EXP {-5 > > ktnus} 
m=11=1 


in an infinite power series of u, U2,..., Un. 

23.16 For the proof, use the property 

n 
E2 Gi] £Gay se 4 ilies igen 

where E(u,,..., Un) is the characteristic function of a system of normal random 
variables. 

23.17 E(ui, U2) = (prie81 + qie1$2)"1( poets +4251 + qoeta + ¥a)S2)Na 

x (p3et1 + 42951 + qge'*1 * ¥2)S2)Na( pye 251 + qae'252)Na: 


Ky = —2S8,S2(N2poq2 + Ns pags). 


24. CONVOLUTION OF DISTRIBUTION LAWS 


24.1 
0 for z < 2a, 
aH for 2a<z<a+b, 
f=) oe 
Gaur for a+ b<z<«€ 2b, 
0 for z= 2b 
24.2 
0 for z=>_x+jyta+b, 
AAS Ot OW? tor t+ Ht b-axzezt+srars, 
1 ee 20, es 
fA{z) = oT; for x+¥Vt+ta-b<zexXt+yrb-a, 


at+b-x-yHtz 


Se Sati See en eee _ 
4ab for X¥+ ¥J-a-b<z<X+fta-b, 
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24.4 

0 for z < 3a, 
= 2 

ae for 3a <z<2a+)b, 
= 2 = 2 

fla) = < E = 30 REO AO for 2a +b <z <a + 2b, 

_ »\2 

ooh for a+ 2b <z< 3b, 

0 for z = 3b. 


24.5 The convolution of the normal distribution law with the uniform proba- 
bility law has the probability density 


Ho} [EY (= E=M] 


Equating the expectation and variance for f,(z) and for the probability density 
f(z) of the normal distribution law we obtain, 


ste 2% 14d (z — z)? 
f2{z) — —  { - 202 }. 


ee ty ES ale 
Z = 2x, w= [ea+8 


If < = 0, then the relative error of such a substitution at the point z = 0 is 








where 


Ay, = oO 100%, (Table 124). 


TABLE 124 





1 l 
24.6 = TPE oO” 


where c= a+ b, 1 = hk/(h +k). (For solution make use of the characteristic 
functions of the random variables X and Y.) 


2 2z 


24.7 Fz) = ze shiz. 
24.8 
e7#/3(] — e- 2/6) for z>0, 
fz) = : for z <0. 


k k 2 2 a ae 
249 fi) = pe exp {Gr eh | Vlas = ka + | 
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where J,(z) is the Bessel function of zero order; 
ky ok 
Cs 11 12 
Kar Koo 


[a? + aZ + (62 — a5) sin? a]; 








1 
Kaa = 903 


psi es a [62 + b2 + (a2— b3) sin? a]; 


kie = ra (az = 53) sin 2a = ko. 


24.12 MOI to px}=+(4-1) + +i (£-1). 
Pr P2 P1 


F(x) = 





=a {1 — pi)pafl — (A — pi") 
— (1 — pe)pill — 1 — po)" }}. 
24.13 The required reserve resistance is 0.37-¢1 = 7.4 kg. 


24.14 (a) P= a iM [1 7 o(2=)| [: "s o(2—2*)) ee 7 














E 


boa wal a 


24.15 P(X,> Xs)=2 : ae o( =e). 


(b) P = 0.75 ~ EPaFS) a = 0(5) __£ 











2 VE? + E? 
24.16 fz) = im ane 
24.17 Fz) = a fa — 5) — a") — 60 — al — 4”). 


24.18 See Table 125. 


TABLE 125 





24.19 P(Z =m) =~ 


24.20 The random variable Y has a binomial distribution. 
24.21 Fn) = P(Z < vn) = 1 -— (#/2n — 1) ( = 1, 2,...). 
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25. THE LINEARIZATION OF FUNCTIONS OF RANDOM VARIABLES 
25.1 Eg ~ 9100 cal. 
7 ; Z ° 
25.2 DQ) x (=) 4 (=) " (=) _ 20,6ntom 
a 200i pt sit alta : 


pl ml 





25.3 E, = 
- 1\2 
[? + (ai _ 4) 
we 
oF oF oy : é 
25.4 D[J] ~ ile oe ne +- aul where j= a 
Pee andd aj, 4. PncPs (ae 
(r+ 3) na(r + 3) PoE ae 
25.55 E = 66.66 m.; Ey, ~ 38.60 m. 25.6 E,, ~ 0.52 m./sec. 
25.7 For the assumed conditions the function V, = —Vcosq cannot be 
linearized. 


25.8 o, © 23.1m.; o, % 14.3 m., 6, % 25 m. 

25.9 oy = dy 8.66 m.; 6, = 7.05 m. 

25.10 E, ~ [(U/(¢ + ®)JEo. 25.11 EF, = 43m. 
25.12 o, ~ 10°*, 25.13 E, ~ 12.98 m. 


25.14 The standard deviation of errors in determination of distance by the 
formula using the data of the radar station is %22.85 m. 


25.15 7 ~ @&) + 5¢°@)DIAI, DLV] = [p')FDLXI + 5 le" @PDLXI. 


2 


2 
25.16 Mis] x 22 F (1 = 3) sin 5, 


ae i 5 
D[S] ~ at [2% cosy + Fa + cos? ¥) + Tp 77 008" : 
= 
| B3 sin? & + E2 cos? « 
Va? — b? sin? & 
25.18 (a) By retaining the first two terms of the expansion in the Taylor 
series of the function Y = 1/X, we obtain y ~ —0.2, D[Y] = 0.16; (b) By re- 
taining the first three terms of the expansion in the Taylor series of the function 
Y = 1/X, we obtain ¥ ~ — 1.00, D[Y] ~ 1.44. 
24.19 (a) By the exact formulas 


pe Get Ga, ~ DIV = or [30° + 127204 + 37402]; 


25.17 E, = 3; X = arcsin (; sin ‘). 


(b) according to the formulas of the ee method 
- _ 4nr* a 
~~ a ae D[V] ~ 167740? . 


25.20 (a) Measuring the height of the cone, we get D[V] ~ 47?, (b) by 
measuring the length of the generator, we get D[V] ~ 3.5777. 


25.21 19.9 mg. 
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2 An ee 
25.22): £= cE [e= (E? + 2E/) + a = 4.67 cm./sec.?. 
(1 — k)?z 


26. THE CONVOLUTION OF TWO-DIMENSIONAL AND THREE- 
DIMENSIONAL NORMAL DISTRIBUTION LAWS BY USE 
OF THE NOTION OF DEVIATION VECTORS 


26.1 A normal distribution law with principal semi-axes of the unit ellipse 
a= 48.4 m., b = 12.4 m., making c; the angles « = 19° 40’ and 109° 40’ with the 
deviation vectors. 


26.2 Fory = 0,a degenerate normal law (deviation vector) Vc? + c2 = 50m. 
For y = 90°, a normal distribution law with principal semi-axes of the unit ellipse 
= c, = 30 m., 6 = co = 40 m., coinciding with the directions of the deviation 


vectors. 

26.3 The principal semi-axes a = 1.2 m., b = 1.1 m. make angles of 33° and 
123° with the x-axis. 

26.4 The principal semi-axes a@ = 5 = 100 m.; that is, the total dispersion is 
circular. 

26.5 a= 30.8m., b = 26.0 m., a = 18° 15’. 

26.6 (a)a=b=25V5m, (b) a = 68.9m, b = 388m, a = 15°. 

26.7 From the system of equations for the conjugate semi-diameters m and n, 
m? + n? = a* + b?, mn = ab/(sin y), we find m = 20 m., n = 15 m. and 


P= o(Z)o(2) = 0.566. 


26.8 |m| = 73.2m., |n| = 68.1 m., e = 74°21’. 

26.9 (a) f(x, y) = 1.17-1075 exp {—7.06-10~2(0.295x? — 0.670xy + 1.31y?)}, 
(b) a = 126.5 m., 6 = 53.8 m., « = 12°10’. 

26.10 a = 880m., 6 = 257m., a = 39° 12’. 

26.11 The distribution law is defined by two error vectors (Figure 42): 

BE, sin Bz BE, sin B; 


ai as sin? (8; + Bo) fa Gea sin? (B, + Bo) 


FIGURE 42 
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a, = 7 — Bo, a = PB; as a consequence of which 


B?E} : : 
ki. = Spt ain* By + Ba (sin? 8, cos? B, + sin? Bs cos? Bz), 
B?E2 i as 
ero ame CGepy Te re 
kip = ___BPEg__ (sin? B, cos 8; — sin® 82 cos Be) 
+2 2p? sin* (Bi + Be) . 
a) . cS, +92 : 
tan 2e = 58 B, sin 2B, — sin? Bz sin 282 _ 


sin? 8, cos 28, + sin? B2 cos 2B. 

26.12 a= 18.0 km., b = 7.39 km., « = 85° 36’. 

26.13 To the error vectors a; and a, one should add another error vector, a3: 
_ VE? sin? B2 + E% cos? Bo 

= sin (Bi + Be) 

for a3 = Bo, which gives at the point C a unit ellipse of errors with principal semi-axes 


a = 41.2 m., b = 19.7 m., making with the direction of the base the angles 74° 20’ 
and 164° 20’. 


26.14 E, = 2.1 m./sec., E, = 0.042 rad. 

26.15 a= 156 m., 6b = 139 m.; the principal semi-axes directed along the 
course of the ship. 

26.16 a= 64.0 m., b = c = 78.1 m.; the semi-axis a is directed along the 
course of the ship. 


a3 





eee (x — 45)? (y — 15)? | (@ +75)? 
26:1) I 2) Spee | 50 R 
26.18 The equation of the unit ellipsoid is 
(e307 | 
a00 «+ Gas t a) 
26.19 


7421 —2568 —7597 
— 7597 2322 9672 
26.20 p = —1.47-10", g = —8.9-10°, p = 65° 45’, uy = 4106, uw. = — 622, 
us = —3484, a = 89.3, b = 57.0, c = 19.3, cos (a, x) = +0.6179, cos (a, y) = 
+ 0.3528, cos (a, z) = 0.7025. 


FIGURE 43 
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FIGURE 44 





26.21 If we take as the x-axis (Figure 43) the direction BK, and as the y-axis 
the direction perpendicular to it, then by the linearization method we find three 
error vectors: 

Di Ep ” as 4 D2Ep 
VD? — H2 = > 25 4S? 
VD? — 


a3 = V D2 — H*E,, og = 90°. 
From this we find: 


EZ [D? cos? « D3 
ky = 55 (Fe a aap): 


ay, = 


2p? H? ~~ D2 
Ep D? sina cosa 
haa = 308 De A 
EZ, [ D? sin? , Fe 
kan = 55 [Be H?2 + Bi - 1): 


26.22 The error vectors az and ag remain the same in magnitude and direction 
as in the preceding problem. The magnitude of the error vector a, caused by the 
error in the distance D, and its direction a, = /K3K2B’ is determined from the 
formulas (Figure 44): 


: 1. 
a, = K,Ky = E.A cose, sina, = 5 sin a, 


where 
heat J : 2D, sin e tan e cosa i D? sin? ¢ tan? e 
VD? — D2 sin? e D2 — D2 sin? « 


V ENTROPY AND INFORMATION 


27. THE ENTROPY OF RANDOM EVENTS AND VARIABLES 
27.1 Since 


é Hy — Hy = pz log4 - Ts 


= —0.733 < 0, 
the outcome of the experiment for the first urn is more certain. 


3 8 5 3 
Sapo: {5 083 — log 13] — 757 *| 
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27.2 p = 1/2. 
Bis Se gee (1 - <7) lo (1 - =.) 

1 33 233 3v3) °° 3V3 
= 0.297 decimal unit, 
a V3 Vi 
Hy 3V3 og 383 = ( <3 ’) ie ( 3 5) 


Il 
| 
= 


= 0.295 decimal unit; 
that is, the uncertainties are practically the same. 


27.4 (a) H= —cos?= 7, 08a cos? = — sin? 7 08a sin? _ (b) n= 


27.5 Since P(X = k) = p( — p)*—}, then 
ALx] = —2logee +O = p) loga (1 — Pp), 

When p decreases from 1 to 0, the entropy increases monotonically from 0 to 

27.6 (a) H{X] = —n[p log, p + (1 — p)loga (1 — p) 

n-1 
— 2, Cup™ — p)?~™ loge Crs 
(b) ALX] = 1.5 log, 2 
27.7 (a) loga(d —c), (b) loga[oxV27e], (c) logz (e/c). 
27.8 H[X] = log, (0.5Ve). 
27.9 H[X | y] = AyLX] = log. (o,V27e(1 — r?)), 
HY | x] = H,LY] = log, (o,V2ne(1 — 7), 


where o, and o, are the standard deviations and r is the correlation coefficient between 
X and Y. 


27.10 HLX:, X2,..., Xn] = I mY TERE 
—-o -@ TT 
x f ae 
exp i aK] 2 Oyj X4Xy 
1 
x lang 2 A3X4X; loge € 


+ log, V Gav] dx, +++ dX» 

= log, V(2re)"|k|, 

where |k| is the determinant of the covariance matrix. 
27.11 ALLY] = ALY] — A[X] + A,X). 
27.12 The uniform distribution law: 


1 
er fora<x<«<b, 
0 for x <a, x > b. 
27.13 The exponential distribution law: 


f(x) = (Fon ex xp {= aati fer a0) 


for x < 0. 
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TMe 2M 


27.15 The normal law: 


27.14 f(x) = ve 


1 1 
f(X1, Xay ++ +5 Xn) = Voma exp {-a19 = ax, — M[X Dy, - Mivip}. 


& Le. 


27.16 Pu = Rs P2j = 





27.17 logs 1050 and log, 30. 
HAS HY Yar PASH My Kaus Ml 
=| of falas X25 ++ +5 Xn) 10a 1 (52) 
-@ -@ Xj 


where I(p,,/@x;) is the Jacobian of the transformation from (Yj, Yo,..., Y,) to 
(%, Xa, ones Xn). 


27.19 (a) The logarithm of the absolute value of the determinant |a,,|, 
(b) 1.85 decimal unit. 








dx, eric dxn, 


28. THE QUANTITY OF INFORMATION 
28.1 (a) 5 binary units, (b) 5 binary units, (c) 3 binary units. 


28.2 For a number of coins satisfying the inequality 3*-1 < N < 3*, 
k weighings are necessary. For k = 5, one may find a counterfeit coin if the total 
number of coins does not exceed 243. 


28.3 J = 500(—0.51 logs 0.51 — 0.31 loge 0.31 — 0.12 loge 0.12 
— 0.06 loge 0.06) = 815 binary units. 


28.4 The first experiment gives the amount of information 


q, = A = A, = loge N — + [k loge k + (N — k) loge (N — &)] 


and the second experiment 


I, = HM, — He = 5, Uk loge k + (N ~ K) logs (N ~ k)] 


_ = [logs ! + (k — 1) loga(k — 1) + rloger 
+ (N —k — r)loge(N — k — r)). 
28.5 The minimal number of tests is three in the sequences No. 6, No. 5 
and No. 3, for example. Hint: Determine the amount of information given by 
each test and select as the first test one of those that maximizes the amount of 
information. Similarly, select the numbers of successive tests until the entropy of the 
system vanishes. To compute the amount of information, use the answer to the 
preceding problem. 
28.6 I _ 2h P(A) loge P(A) | 
: T D1 P(ay)ty 
where P(a;) = P(A, if the code a, corresponds to the symbol A, of the alphabet. 
For code No. 1, 
= —— = 0.304 binary units/time units. 


PS 
wl? 
oo 
Ln 


For code No. 2, 
= — =~ = 0.283 binary units/time units. 
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28.7 For a more efficient code, the symbols of the code with the same seria! 
numbers arranged in the order of their increasing durations should correspond to 
the symbols of the alphabet arranged in the order of decreasing probabilities; that is, 
the symbols d, c, b and a of the code should correspond to the symbols A,, Az, A3 
and Ag. The efficiency of such a code is 








I 1.782 : ee : 
T.. ~ 455~ 0.391 binary units/time units. 
29.8 (=1— fh a1 + 08102 0.8 + 0.1 logs 0.1 + 0.1 logs 01 _ gy 
Anas logs 3 


28.9 (a) See Table 126. 














TABLE 126 
Letter A B 
Probabilities 0.8 0.2 
Coded notations 1 0 





(b) See Table 127. 


TABLE 127 







Letter combinations 


Probabilities 0.64 0.04 


Coded notations 


(c) See Table 128. 


TABLE 128 











Letter combinations AAB | ABA | BAA ABB 


0.128 | 0.128 | 0.128 | 0.032 0.008 


011 010 001 00011 00000 













Probabilities 











Coded notations 





The efficiencies of the codes are respectively: 





0.722 _ 1.444 _ 2.166 _ 
(a) j= = 0.722, (b) FF = 0.926, © F194 = 0-992. 
28.10 (a) P(1) = 0.8, P(O) = 0.2, 4, = 1 — 0.722 = 0.278, 
0.96 
(b) PC) = 75 = 0.615, PCO) = 0.385, /, = 1 — 0.962 = 0.038, 
1.152 
(c) PC) = s754 = 0.528, P(O) = 0.472, J, = 1 — 0.9977 = 0.0023, 


2.184 
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28.11 (a) See Tables 129 and 130, 


TABLE 129 


Letters 
Probabilities 


Coded notations 





TABLE 130 







AA | AB | BA | AC | CA | BB 


0.49 | 0.14 | 0.14 | 0.07 | 0.07 | 0.04 0.02 0.01 


010 | 0011 | 0010 | 0001 000001 | 000000 


Two-letter combinations 





Probabilities 








Coded notations 





(b) The efficiencies of the codes are 0.890 and 0.993, respectively. (c) The redun- 
dancies of the codes are 0.109 and 0.0007, respectively. 


28.12 See Table 131. 


TABLE 131 
Coded Coded Coded Coded 

Letters notations Letters notations Letters notations Letters notations 
— 111 p 01011 001001 X 0000100 
oO 110 B 01010 001000 K 0000011 
e,é 1011 ut 01001 000111 iz@) 0000010 
a 1010 K 01000 000110 naa 00000011 
MH 1001 M 00111 000101 ul 00000010 
T 1000 pat 00101 000100 I 00000001 
H 0111 I 001101 000011 3 000000001 
c 0110 y 001100 0000101 i) 000000000 





28.13 Use the fact that the coded notation of the letter A; will consist of k, 
symbols. 


28.14 In the absence of noise, the amount of information is the entropy of the 
input communication system: 
I = —P(A,) loge P(A) — P(A2) loge P(A2) = 1 binary unit. 
In the presence of noise I = 0.919 binary unit; it decreases by an amount equal to 
the magnitude of the average conditional entropy, namely 
— P(a;)[P(A; | a1) loge P(A: | a1) + P(Az | a1) loge P(Az2 | 21)] 
— P(a2)[P(A1 | Az) loge P(A, | Q2) + P(A2 | Az) loge P(A2 | a2)], 
where 
P(A,)P(a, | Aj). 


P(A; | a) = P(a,) 
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28.15 If the noise is absent, 7 = H, = loge m; when the noise is present 
l= H, — Hz = loggm+ plogep + qlogeg/(m — 1). 


28.16 I = logem+ 2 2 P(a,)P(A; | a;) logs P(A; | a), 
where 
Pla) =~ > py, P(A; | a) = PL. 
ms 27 Pu 


VI THE LIMIT THEOREMS 


29. THE LAW OF LARGE NUMBERS 
29.1 (a) P(|X — x| > 4E) < 0.1375, (b) P(|X — x| = 30) < 1/9. 


29.2 It is proved in the same manner as one proves Chebyshev’s inequality. 
For the proof make use of the obvious inequality 


I f(x) dx < [pete se dx, 


where Q is the set of all x satisfying the condition 
2274+ InJ 
> + 
€ 
29.3. Using arguments analogous to those in the proof of the Chebyshev 
inequality, one obtains a chain of inequalities 
P(Y¥ >«)< x i a dF(e*) < e~**M[e™*]. 
29.4 Use the Chebyshev inequality and note that x = m+ 1, and M[X?] = 
(m + 1)(m + 2), hence, 
D[X] 


PO < X< Am+ 1) = PUX- x <m+)>1—-Tae 


29.5 Denoting by X, the random number of occurrences of the event A in 
n experiments, we have P(|X, — 500| < 100) > 1 — (250/100?) = 0.975. Conse- 
quently, all questions may be answered ‘“‘yes.”’ 


29.6 The random variables X, are mutually independent and have equal 
expectations <, = 0 and variances D[X;,] = 1, which prove that the conditions of 


the Chebyshev theorem are satisfied. 
29.7. For s < 1/2, since in this case 


lim D |; ) x,| =lim4 > ke =0. 
k=1 


nyo n 


12 | _ 1 . —— 
29.8 lim |: > x,| = lim Sy In (a!) = lim 55 In (at 4% Vom} 


n+ oO k=1 n+ 
: 1 1 Jon 
= lim 34(2+ 5) In2—n+I1nV2z7 
nao n 2 
. Inn 
= lim — =0, 
nao Nn 
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which proves the applicability of the law of large numbers. 
29.9 (a) Not satisfied, since 


: Lec . 4(4" -— 1) 
1 = = pi Senet 
tim of; 3, 4] = fin “SEP ==, 
(b) satisfied, since 
1 n 
lim Df; 3 a} = Jim 5 = 0 
(c) not satisfied, since 
: ne + 1)... ‘4. 
ae ote 3%} > tim N= 5 
29.10 Applicable since the inequality 
1 2 1 2 c 
0<DI- i c 
2 me “| < ne 2 DLX;,] < = 
where c is the upper bound of DLX,] for all k = 1,2,...,”, holds for ki; < 0. The 


relation 
: 12 
lim D<— XX, > = 0, 
ne i Qn «} 
follows from the inequality. 
29.11. To prove this, it suffices to estimate 


1 2 n n-1 
p|- > X| = + | > og + 2 > rates ea] 





k=1 k=1 k=1 
where 
o2 = D[X,], and Tees. = MI(X%, — XM Mev = Xi+1)1, 
OnOn +1 
Replacing all a, by their maximal value 5, we obtain 
1 < Si 228 
oI; 2 x,] . n? ae 


hence, it follows immediately that 
n 
lim | > x, | = 0 
n+@ nN yei 
29.12 Applicable, since all the assumptions of Khinchin’s theorem are satisfied. 
29.13. Consider 
1 
D[Z,] = Df > x,| =.-5 


n 


nr 


nr c 2 n 
2 pa pee <a z 2. Irul 


where oa; is the standard deviation of the random variable X;. Since r;,— 0 for 
|i — j| +0, then for any e > 0, one may indicate an N such that the inequality 
|r| < « holds for all |i — j| > N. This means that in the matrix |r, ||, containing 
n? elements, at most Nn elements exceed « (these elements are replaced by unity) 
and the rest are less than e. From the preceding facts, we infer the inequality 


1 nr n 


3D, > hy 


t=1 7=1 








Nn 1, _ oN 
<a t+ ln’ — Nae =e + — (1 e), 








therefore, lim,.. D[z,] = 0; this proves the theorem. 
29.14 The law of large numbers cannot be applied since the series 


( 
. a 


defining M[X;] is not absolutely convergent. 
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30. THE DE MOIVRE-LAPLACE AND LYAPUNOV THEOREMS 


30.1 P(0.2 < = < 0.4) = 0.97. 30.2 P(70 <m < 86) = 0.927. 


30.3. (a) P(m = 20) = 0.5, (b) P(m < 28) = 0.9772, 
(c) P(14 < m < 26) = 0.8664. 
30.4 In the limiting equality of the de Moivre-Laplace theorem, set 


Zt 

Pq ; 

and then make use of the integral representations of the functions ®(x) and D(x). 
30.5 Because the probability of the event is unknown, the variance of the 


number of occurrences of the event should be taken as maximal; that is, pg = 0.25. 
In this case: (a) n % 250,000, (b) 1 = 16,600. 


30.6 In the problems in which the upper limit of the permitted number of 
occurrences is equal to the number of experiments performed, 6 turns out to be so 
large that ®(5) ~ 1. In this case, n ~ 108. 


30.7 nz 65. 30.8 p = 0.943. 30.9 67.5. 

30.10 J = {5 x? dx may be considered as the moment of second order of a 
random variable, uniformly distributed over the interval [0, 1]; then its statistical 
analog determined by a Monte-Carlo method will be J, = (1/n) >f=1 X%, where 


X, are random numbers on the interval [0, 1]. With the aid of Lyapunov’s theorem, 
we find that P(|Ji000 = J| < 0.01) = 0.71. 


30.11 nw 1.55-10°. Set J, = (7/2n) DE -18in X,, where X,, are random numbers 
from the interval (0, 7/2). 


30.12 (a) Since the difference 
P(c) ~ Pc) = | — PA] x T= PBI ADL, 


b=-a=e 


from the point of view of the law of large numbers both methods lead to correct 
results, (b) in the first case, 9750 experiments will be necessary and in the second 
case, 4500 experiments. 


30.13 (a) 3100, (b) 1500. 
30.14 In all three cases the limiting characteristic function equals e 
30.15 lim Fy,(u) = e-*?, 

nwo 


—u2j2 


VII THE CORRELATION THEORY OF RANDOM 
FUNCTIONS 


31. GENERAL PROPERTIES OF CORRELATION FUNCTIONS AND 
DISTRIBUTION LAWS OF RANDOM FUNCTIONS 


31.1. Denoting by f(x, x2 | f1, f2) the distribution law of second order for the 
random function X(t), by the definition of K,(t,, te) we have 


Kt, te) = [ [ (x1 — ¥1)(%2 — Xo) f(%1, x2 | fh, fe) dxi dxe. 
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Applying the Schwarz inequality, we get 
|Kx(t1, t2)|? < i I (x1 — ¥1)?f (1, x2 | fi, te) dx, dx 


: | i (x2 = X2)*f(x1, x2 | hi, to) dx; dx = Ox 7 x(t2)» 
which is equivalent to the first inequality. To prove the second inequality, it suffices 
to consider the evident relation M{{X(41) — X(t:)] — [X(te) — ¥(t2)]|?} = 0. 

31.2 The proof is similar to the preceding one. 

31.3 It follows from the definition of the correlation function. 

31.4 Since X(t) = >%-, A; + c, where c is a nonrandom constant and zx is the 
number of steps during time t, we have DLX(z¢)] = M[no?] = Aro?. 

31.5 The correlation function K,(7) is the probability that an even number of 
sign changes will occur during time 7 minus the probability of an odd number of 
sign changes; that is, 

= (Ar)” <= _(A7)?" 4? en at = e- 2a 
Kx(7) = Dy on” Dora =e 
31.6 Since M[X(t)X(t + 7)] ¥ 0 only if (t, ¢ + 7) is contained in an interval 


between consecutive integers and, since the probability of this event is 0 if |r] > 0 
and (1 — |z|) if |z| < 1, we have for |z| < 1, 


K,(1) = (1 — |7/)MLX2] = (1 = |x|) x [ x ep ped 
=A+2A-Dd —- |z|). 





Consequently, 
Xr 2)(A _ < 
isa: { +2A+ D0 =e), ll <1, 
0, |r| > 1. 
31.7. Letting ©, = ©(4,), O2 = O(t, + 7), for the conditional distribution 
law we get 
f(A, 82) 
6.16, = 5°) = —S—) 
t( 2 | 1 ) f(8:) 


where /(@,, 92) is the normal distribution law of a system of random variables with 
correlation matrix 

Ko(0) Ke(7) 
Ke(7) K,(0) 
Substituting the data from the assumption of the problem, we get 














= i, f(82 | 81 = 5°) dbz = 5 [1 — ®(2.68)] = 0.0037. 
15 


31.8 Denoting the heel angles at instants rand ¢ + 7 by ©, and Ok, respectively, 
and their distribution law by /(6;, 92), for the conditional distribution law of the 
heel angle at the instant of second measurement, we get 


8 
[PP 16:, 60 a8. 


FG —% < Oy < 60) = a= fe 
[PE 100s. 00) ate 


The required probability is 
1 


P= ——__—— [% 62 [o( 5) (= *}] 
= —-—}/o| > @(—° ——-= || dé... 
2V 2m ov (=) ie exp { zi} aviz=er \anl =e 
@ 
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31.9 Denoting X, = O(t), X2 = O(t), Xs = Ot + 70), the correlation matrix 
of the system X,, X2, X3 becomes 
K,(0) 0 Ko(79) 
An! = 0 — K,(0) —K(r) ||, 
Ke(t.)  —Kol(r0) K,(0) 


which after numerical substitution becomes 


36 0 36e-%5 
Wan | —! 0 36(0.252 + 1.577) 0 
36e7 9-5 0 36 














Determining the conditional distribution law according to the distribution law 
S(%1, X2, Xs) 


| J (%1, X2, X3) dx2 
f(xg | xa = 2, x2 > 0) = — A _______|__ 
| if S(%, X2,X3) dX dXy j 
—-@ x1= 


we obtain for the required probability, 
10 
p= | S(%3 | x1 = 2, X2 > 0) dxs = 0.958. 
-10 
31.10 p(t) = a(t)x(t) + b); Kyla, te) = ene te). 


31.11 f(x) dx = al Sala) fo(8) da dé; f(x) = = Sane {-# 702 =}. 
x<acosé <xt+dx 
31.12 The probability that the interval 7 will lie between 7 and 7 + dr 
is the probability that there will be 7 points in the interval (0, 7) and one point in 
the interval (7, 7 + dv). Since by assumption these events are independent, we have 


Po <T<7+dr)= ay e~—*) dr; 


that is, 
aa Te 


f(r) = eo 
tn ae 
31.13 (@ = isa exp { wy, 


32. LINEAR OPERATIONS WITH RANDOM FUNCTIONS 





32.1 Since K,(r) has no discontinuity at 7 = 0, 
K3(r) = — —_ K,(r) = ave-(1 — afr}). 
32.2 K,(r) = ae? + Bre *"(cos Br — Rin pln!) : 
D[¥(2)] = K.(0) = ala? + B?). 


32.3. Using the definition of a mutual correlation function, we get 


Regt) = M{LX*0) ~ x +) OEt “eee 


£ MILX*(0) — XG +) -— B= SK, 
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32.4 Since any derivative of K.,(7) is continuous at zero, X(t) may be differen- 
tiated any number of times. 

32.5 Twice, since (d?/dr?)K,(7)|,=0 and (d*/dr*)K;(7)|1=20 exist, (d°/dr*)K.(7) 
has a discontinuity at zero. 

32.6 Only the first derivative exists since (d?/dr7)K,(7) exists for 7 = 0 and 
(d3/dr*)K.(7) has a discontinuity at this point. 

32.7) Rzx(t) = «a2(r — to)e~2!*~ Fol, 

32.8 D[Y(s)] = 02, D[Z(2)] = a0?2. 

32.9 K,(r) = 2a%02u2e-?? (1 — 2027). 

32.10 The distribution f(v) is normal with variance o? = a(a? + 8?) and 
6 = 0, P = 0.3085. 


32.11 z(t) = X(t) + H(A); 
KAtr, te) = Kets, t2) + Ky(ti, te) + Rey(tr, te) + Ryx(tr, fe). 


32.12. X(t) = > X(t); KAh, te) = > Ku,(t1, te) + > ys Rant,» t,). 
FHL J=1 t=1 751 
2 dé t#7 
32.13 K,(7) = K,(7) + age K,(7) + Tr K,(7). 


32.14 K.(r) = ote otf + alr] + J air? 


2 4 
+ a (a?r? — alr] — 1) + 7 (a?7r? — 5a|z| + a}. 


t i 
32.15 Since Ky(t1, tz) = iis if K,(tz — t{) dtg dti, if we let tg = 4; = t, pass 
ie) Q 
to new variables of integration, and perform the integration, we obtain 
t 
DI Y()] = Kt, 4) = 2 | (¢ — 7)K,(7) dr. 
re) 


32.16 Solving the problem as we did 32.15, after transformation of the double 
integral we get 


K,(t1, te) = le (to — t)Ky(r) dr + i (4, — 7)K,(r) dr 


7 I ie or ee cre 


0 
t 
32.17 Rey(tr, t2) = ie Kilt, ) dé. 32.18 ~=D[Y(20)] = 1360 cm.?. 
(8) 


dx(t t 
32.19 p(t) = aox(t) + ay He) + bs | e~1 X(t) dt + c, 
is) 


a a 
aC eC eae ae OK Ati, ta) 
h Oo 





4 Be a°K(t1, te) 
+ @ty ty 


‘1 4 ta : 
+ agb; i e~™1K,(ti, te) dt + [ e~2K(t1, £3) a 
o 
4 OK;(ti, te) i OKA tr, 3) 
+ a,b fl en ty xlli, le , AEE wlti, te ; 
191 : 1 a dt; + : e72 one dts 


. to [ty 
2 ao es ‘4 , , 
+ 63 i [ e- MEK Ct, £8) ti dts. 


ie) 
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OK,.(t, to) + ad 0?K,(tr, to) 


32.20 Rya(ta, t2) = ac “FE ar? 


0? K,(t1, fo) O°K,(t1, to) 
Bi dig ee Ohars 
32.21 Since the variance D[A(rt)] is small, sin @ = 0, 


DIAV(O] = 2e2 | — DK) dr = Zale — La - ee], 


which after substitution of numerical values leads to o,, = 18.6 m./sec. 


32.22 Using the definition of the correlation function as the expectation of the 
product of the deviations of the ordinates of a random function, and the formulas 
for the moments of normal random variables, we obtain 


K,(t) = a2Kg@(r) + b?K(7) + 2c?K2(r) — 2abK2(r). 
32.23 K,(r) = 2a2K3(r) + 2b?K2(r) — c?Ko(7)K,(7). 
32.24 K,(r) = e- 7 [1 + 2021 — 20?7)]. 


+ be 


32.25 R(t) = — F aate~*'(1 + al7| — ar). 


32.26 Ky(ts, 2) = a*(ta)alts)Kel7) + 6*(t)b() “AO 





d? Kee), 





ie ose + b*(t1)a(t2)] 


32.27 It does not exist. 32.28 (a) Stationary, (b) nonstationary. 

32.29 o2 = 6.5-10°o2[0.1¢ — 0.2 + 0.1 cos (2.48-10~9r) — 8.0 sin (2.48 -10~ %¢)]. 
For t = 1 hour, oy ~ 1.5 km. 

32.30 Df[a(t)] ~ ayt; D[B(t)] ~ dit; 


re =. I [cos Ar + 2) ; k2 arcsin ky(r) 


ges OAT ae kata)| de 


2 [° 1 . 
by = aa ii (cos At + 2) a k arcsin k,(7r) 


cos A 
+ k? az 





arcsin kata) dr 
ky(7) and K,(7) are the normalized correlation functions Y(t) and @(r); \= Vpq. 


32.31 D[Z(1)] = [ (i aes {ars ee t Ce eae C net eee 


x K.(t2 — 71) dr; dt2, 
where 


y(7) = 2 [ (t — 71)K,(71) dry. 


33. PROBLEMS ON PASSAGES 
33.1 7, = 10x[1 — ®(1)Je!/? = 16.45 sec. 
33.2. D[V(t)] = 0.25 cm.?/sec.?. 


33.3 The number of passages (going up) beyond the level a = 25° equals the 
number of passages going down beyond the level a = —25°; consequently, the 
required number of passages 


re Vet P + F exp { -3 sy 11.9. 
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TT 0.9), _ x) = 
33.4 isé ! o( 5 9.91 sec. 


33.5 Starting with ¢ = (V4n?p2 — a)-}. 
33.6 The problem reduces to the determination of the number of passages 


of the random function X(t) beyond the level Vw./k (going up) and — V wolk 
(going down). 


Answer: i Vaz + B? exp { - 2h. 
7 a 





33.7. Since the radius of curvature is [v/F()1, the sensitive element reaches a 
stop when V(r) leaves the limits of the strip +v/Ro, which leads to 


! 2 2 v? 4 
S Va? + B? exp {- are 5 aR Sec. 
as 2 
33.8 Forh 2 54.5 m. 33.9 Q= exp {= exp {-\. 


33.10 Denoting by f(x, x1, X2) the probability density of the system of normal 
variables X(t), X(t) and X(t), we get the required probability density, 
0 
| I(x, 0, X2) axe 
fe) = = 
[7 pee 0,20) ara dx 


Considering that the correlation matrix has the form 


K,0) 0 K,(0) 
Iku] =} 0 -KO) 0 |, 
K(0) 0 Ki¥(0) 


we find after integration that 


m= gen Sls ob) 
ik eet dad Oh 


33.12 The ie number equals the number of passages (from both sides) 
beyond the zero level; consequently, 


DIX(1)] _ Te 75 
DIX@] 7 


= 1 Q e Aa zat, 4 Aspe 3A Zz. 
1a hap cple |" [ [o (te BE4 Aets + due) 
33 - . 872V Ai Ass -@ cai V AssAa 


+ (Ase sate — oat = Aasts\ 2 
5542 











1 
x EXD {ae | 428 + AgaZe + 2A34Z324 


A 2 
_ (Ag5Z3 + AasZa) |p acs ds, 





Ass 
where 
: kag K34 Kas 
: Ay = kiykea a ki, A, = kaq kag Kas ’ Ayn U, [= 3, 4, 5) 
Kz Kas kss 
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are the cofactors of the determinant A, and k,, are included in the answer to Problem 
33.14. 


33.14 jis the probability density p of sign changes for ¢, and ¢, in the vicinity 
of the point with coordinates x, y. These are related as follows: 


_ ple, De: al(x + dx, y) _ L(x, y) _ Xx, y + dy) 
Pa eS ax 0; HATED <0; BEM > 9, SOM <0) 
- a(x, ¥) OY) eg < BOY . _ PY) | 


The probability p dx dy can be computed if one considers that K(¢, 7) uniquely 
defines the distribution law of 0f/@x, O€/dy, a?f/ex?, o?f/ey?. Performing the 
computations we obtain: 





22 Az [1+ kaa 
n=p= 


=< + arctan — ’ 
4? V ALA VA \2 (5 7 )] 
Ay = kirken — ke, Ag = kaskas — Ka; 


ku = [ i Si(w1, We)w? dar, dua; koa = {i | Sw, w2)wz dw, dw; 


where 


Kz = i i Sr(ai, W2)wiws dw, dws; kag => | i S(wi, We)wt dw, duz; 
kag = i I S (wi, we)ws dw, dws; ky. = i | Sia, W2)w1W2 dw, dw; 
kas = | i S(w1, W2)Wiwe dw, dads; Kas = | | Sr(w1, we)w we dw, dug; 


kss = I | S(@1, We)wiwz dw, dws. 


34. SPECTRAL DECOMPOSITION OF STATIONARY RANDOM 





FUNCTIONS 
34.1 K(r) = 2a snr. 343 Xi) = IFO Hsmye = 1) 2. 
34.3 Denoting 
—— e7altl~ ~{wt = ieee es 
J(a,w) = a dr Fare. 
we have 
oJ 2a a3 
ONS Saas a are) 
. w\? 
sin = 
o? 2 
34.4 S(w) = 5 z 
2 
ao? aw? + a? + pe _ ao2 w? + a? + eC 
34.5 SW) = G+ + BD? — Aw? ? —  — BP + dae? 
_ ao? w? + a? + B? 


“mn (w? + a? — B?)? + 402 2° 
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20? (a? + B?) 2 207 a(a? + B?) 
34.6 S(w) = cs (w? + 0? + B2? — 4B?w? Sa (w? — a? — B?)? + 4a%w? 
2c? a(a? + 8?) 


~ P+ a? — BA? + darB? 
34.7 Solving this problem as we did 34.3, we get 
o? 16a°w* 
a (w? + a)# 


S(w) = 


2anw? 
a [(w? + a? + B)? — 4B7w?] 
34.9 Two derivatives, since S,.(w) decreases as 1/w? when w increases. 


34.8 S(w) = 


= ] = AsO; 
34.10 S(w) = = ot + af 
dS(w) _ 2a07w 
dw ~~ a[ (as? SZ a2 = p?)? + 40287)? 

x {4B%(a? + 6%) — (a? + B? + w)?}. 
Consequently, for w = 0 there will always be an extremum. If, for.w = 0, the 
expression between brackets is negative, the sign of the derivative at this point 
changes from plus to minus; there will be one maximum at this point, and no other 
maxima. Thus, the condition for no maxima except at the origin is «? > 382. For 


34.11 


oc 1 ; 
a7 w* + 48?’ 
that is, S(w) also can have only one maximum at the origin. Therefore, if a? > 3f?, 


then there exists one maximum at the origin, if a? < 38?, thete will be one minimum 
at the origin and two maxima at the points 


w= +o, We = Vo? + p? V2Vv RB? — Vat + B?. 


o? = 382, S(w) = 


34.12 Since 
aru? 
SA) = Care ae 
then 

oo 2 
DLX(1)] = | Si(w) dw = 52. 
oes 2a 

34.13 Since 


S.(w) = SaJz exp {-%}- and Ryx(7t) = < i exp {iwt}S,(w) dw, 
then 
; 2 
Sxx(w) = IwS,(w) = va {-3} = S,3(w). 
34.14 Since 
K,(r) = ae~*!"!(k2Q1 + «| 7) + &?k3Q1 — @ | 7)], 
the Fourier transform leads to 


2 
Sa) wa (kd + kao’), 


mw? + « 
| BAIS Reg(s) = Kal + 10) = |” ele *0S,(0) divs Sey(w) = eS), 


34.16 S,,(w) = (iw)"e*0[S,(w) + Syu(w)]. 
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34.17 Since 
K(r) = Ket) Kg(1) = araa(a} + BER + Be~ es * 201! 
Oy 


x (cos Bit — 2, sin Bslr|) (c0s Bot — ze sin Bale] i 


then the Fourier inversion leads to 


Sw) = a{ soos +@w—B)siny — acosy’ + w+ 8)siny’ 
7 (w — B’)? + o? (w + BP’)? + a? 
acosy” + (w — B’)siny” acosy” + (ww + B’)siny’ 
7 (w — B’)? + a? = (w + 8”)? + a? \, 
where 
a@=o,+%, P =f8,+f2, PB =Bi-f, Y =v tye, vy =¥1— Yas 


2 2Q22 

tanyi = B tan y2 = 3’ a = AGneas ae yo. 

34.18 Since K,(7r) = K,.(7r)K,(7) + x*K,(r) + j?K,(7), then 
Q1d2(a, + a2) % xX dene, oe Varo, 

mw? + (a: + @e)?] mw? + 08) (w+ af) 

34.19 Since K,(7) = K,(r)Ke(r), the Fourier transform leads to 

@,Q2 


S.(w) = 


Sa(w) = Air COS 1 COS 2 
7 {2 cosy’ —(w — B’)siny’ — acosy’ - w+ B)siny’ 
(w — Bp’)? + a? (w + B’)? + a? 
4. %£08 y’ —~@w—f’)siny” — acosy” — w+ ’)sin mh, 
(w — Bp’)? + o? (w + B”)? + o? 
where 


a2=a ta, Pp’ =Bi+ Be, B=Bi-fo, Y =v tye vy =¥1 — 
tany, =o!) tanys = 2: 
mo Bi v2 Ba 
34.20 Applying the general formula 
S,(w) = 2 | (w — w,)2S,(w — 0 )w?S,(w,) dw, 


and the results of Problem 34.17, we get 


_ 2a?aB* 1 4(a? + B?) _ « 
a m COs y {= + 4c? i (w? + 4a? — 487)? + 160262)’ a aa B 


4aa a x? 
34.21 S,(w) = nae (tam Lay ern 3): 


—_ 2 2 
34.22 S,(w) = w*(taV In exp {~3} + ax exp -{=}). 


34.23 S,(w) = S,(w) + cost g f S,(w — w,)So(w) deo, 





+ sin? 24 i ” Solw — ons)Se(ws) deo + I ™ Sylw — e:)Sy(es) dos), 


where S,(w) = Si(w), Sew) = S2(w), Sy) = Ss(w); 
aja; a? + B? 

a (w? + af + B?) — 4B?a?’ 
and all the integrals may be computed in a finite form. Because the final result is 
cuinbersome in the present case, it is preferable to use numerical integration methods. 


Siw) = j= 1,2,3 
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34.24 Since K,(7) = 2K2 pe + 4x?K,(7), then 


e 2 
S,(w) = aa ie Ae see 





aan 1 — cos— 1 
34.25 Siw) = — 5 +2 (1-$)sin$ , 
TW (43) Wa 
where 
Tygn? { 1 nin — IT ny jén?T arn — INT 
2 — —— —- —?P> pear ————_]> 
Oa? \3aT [: ay 2a 4r «Qa To? 1 = 2a 
= 4? = 2(Q, + Q.) 
T= 0,0,’ a= —anere 


and j, is the intensity of photocurrent created when one hole coincides with the 
aperture of the diaphragm. 


35. COMPUTATION OF PROBABILITY CHARACTERISTICS OF RANDOM 
FUNCTIONS AT THE OUTPUT OF DYNAMICAL SYSTEMS 


35.1 Y(t) is a stationary function; consequently, 
c2 
So) = 
which after a Fourier inversion yields 
ee Stee 
K,(7) = ar e | I, 
35.2 Since Y(t) is stationary, finding the expectation of both sides of the 
equation we obtain that ¥ = (6,/a,)x. The pe density is 
= bzw? + b? gw + bi 
Slo) = ary gt Ss) = = aa aw 
which after integration between infinite cme gives 
o2 aybea + Abi 
AopQ, ay + Ace 
nt w?[S;.(@) + c?w?So(w)] 
(w? — n®)? + 4hPw? ® 


D[Y(¢)] = 


35.3 Sifw )= 


where 
Sew) =e ee +B, asea(od + 63) 
i) = Ge? = BE = of? + dou? (a? — BE ~ 08)? — 40807] 
35.4 Since by the assumption of the ere a(t) can be considered stationary 
S.(w) = a Siw), 
where S,(w) is obtained as in Problem 35.3. Integrating S.(w) between infinite 
limits with the aid of residues, we get of = 2.13-10~® rad.?, og = 1.46-10- rad. 
207 aa? + B?) 
m[(w? — a? — 6)? + 40202] 
where a = h, B = Vk? —h?, o? = wc?/2hk?. Applying a Fourier inversion to 
S,(w), we get 


Sow) = 


35.5 S,(w) = 


K,(r) = o%e-*'"(cos Br + 3 sin Alr|). 
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2oga(a? + B?) 


CE 5 dC 2 
99:6 Se) = GP a? — BYP + 47a] 


K,(7) = age-"'(cos Br + sin |), 
where 
kT lr 1 
2 —s3 Sa ay = — — r2 
eae a= a7 B 57 V 41D r?, 
6 
dee Saye 4(49w® + 25) 


mw? + 1)?(w? + 4)(w? + 9) 
35.8 No, since the roots of the characteristic equation have positive real 
parts and, consequently, the system described by the equation is nonstationary. 
35.9 Since f,(f) is stationary, it follows that 
weS.(w 
Sl) = ar thie Fal” 
ac(a? + B)ws 
[(B1 — 8)? + (or — @)?][(B:1 + B)? + (a1 — @)?] 
x [(B1 — B)? + (a + )710(B1 + B)? + (ar + @)?] 
. {Ce + B2 + a? + a2)? + 4(a?B? — 2028? + at — 2020? + 028?) 
os (af = oe B?) 
4 (—B? + B2 + a2 + a7)? + 4(a?8? — 2078? + at — 2a%a? + “PD, 


D [2.(t)] = 


ata? + B) 
a=h, Bf, = Vor— Pe. 
35.10 Letting wo =n, a = 3-10-*g?, we get Df[e(r)] = D[Z.(t)], where 


D[Z.(t)] is mentioned in the answer to Problem 35.9. Substituting the numerical 
data we get D[e(rt)] = 0.06513; a, = 0.255. 


35.11. The formula is a consequence of the general formula given in the 
introduction. 

35.12 Letting w) = k, we obtain D[O(t)] = D[Z.(t)], where D[Z.(t)] is given 
in the answer to Problem 35.9. 

k2S,.(w) 
(kK? — w?) — 2hiw’ 

Ryx(7) = k? f zs efet (2 — w?) — thiw _ cee hits dw. 

35.14 The independent particular integrals of the homogeneous equation are 

e-', e~™, the weight function is p(t) = (1/6)(e~-' — e~”), 


238 = Texp {—r 4 gal{1 + 0[v2 (ar - 2)]} 
— exp {-1 + alae + o[ v2 («= ~ 33)) | 
+ 7 exp {+ + act - o|v3 (u + x) |} 
~ exo foe + BBN — [va (ar + 24)]) 
35.15 DIY) ~ 201 = BIZ + [" [* prrvaCee 


x K,(t2 — 71) dr, drzg — 2 Re | p*(7)Rx2(7) dr, 
o- 


35.13 S,{w) = 
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where the minus sign in the lower limits of integration means that the point 0 is 
included in the domain of integration. 


o? 2a +a 
35.16 D[Y(t)] = a(a + a) [+ + as oy = 2at)| : 


35.17 & = const., whose value may be taken zero by a proper choice of the 


origin; 
2 p2 w\2 2 
ae ( +2) 12 + he al, (t — 7)Ky (1) dr. 


35.18 Replacing X(t) by its spectral decomposition, we obtain the spectral 
decomposition of 


= a ee —at+iot —(w + Wo) a5 (a A h)ji -(h-1o,)t 
mt ie —w? + Qhiw + k? le " 205 E . 





—(@y — w) — (a - 


at 2wWo 


h)i e-o+t00 dP(w), 


where w) = Vk? — h?. From this it follows that 


° S.(c) 
Ky, (ty; ta) = i CES, 


x {eneersipetotat + wee? 
x [[(w — wo)? + (a = h)*Je7 Hotta) + [(w + wo)? + (a — AY?) 
x ef@oltg fp 4 [w2 _- (w — ait hi)?] 


x et@olt +2) + [wo2 — (w + ai — hi)*Je~ or +42] 


ae 50, e7 Gatto; “Rela — Wo + ai — hi)e~ ‘o's 
+ (—w — wo + ai — hije'?o'2) 
i a e2- tte Ata) — wo — ai + hi)et@ots 
Wo 


+ (-—w — wo -— att hide tes)} du, 


which, after we substitute the expression for S,(w) and integrate with the aid of 
residues, gives the final result in the finite form: 


Ky, (t, ta) 


Gey [e- at, — Mya = N,][e-%*t 2 + Mea — No] 
= a[(a? + k? — 2ha + a7)? — 4a*(h — a)?] 


rT [e%~ 2-11 + My(iB — y) — Ni] [e88~%- 2 — Ma(iB — y) — “alt, 
2y8[(B? — y? + «?) + 2iBy]\(B + iy) 
M, = e-* sin Bt, 


= et; ———,—", N,; = e-*(cos Br, + as ? sin ps), j= 1,2; 
B B 
y= |h—-al, B=a. 
35.19 K,(t1, te) = F exp {3 (12 + 2 + 2a) 





x {t0%, — «) + D(a))[O(t. + a) + Dt, + a] 


= = |" exp {—} stb hog + a) ae}, to > 
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| aie ‘6 eer 
«(0 S| + bSel} 
35.21 ¥(t) = @y, +2 eer ee 
Ky(ti, t2) = , I : I ' K,€, 7) dé dn = — 
x {Sa — to) + maa: — 0) + AG — 19) 


t? 62 2 t2 2 DAA ts 
- [(B- a+ Zlen -(2-3044 eo 


Au vddep ® pt, x(6) aé: 


Ky(t1, t2) = 2? , > A mA Yili) dtak 


i,4ma1 


1 


35.22 p(t) = 4 ee 
1 


ns [ : it pli; Opa) AE) ae tty, 


where yi(t), ..., ¥n(¢) are the independent particular integrals of the corresponding 
homogeneous equation, 


v0) ya(0) “++ Yn(0) 
Av yi(0) y2(0) vs+ yal) : 
YE-PO) yFBO) +++ yE-PO) 


and A, are the cofactors of this determinant. 


35.23 Since the solution of the system leads to 
t 
Y,(t) = -2 [ [e~¢-4) — e-2¢-ty]X(t,) dts 
0 
+ 2[¥2(0) — YiO)le~ + [2¥10) — Y¥2(0)Je~*, 


and 
K,(7) = 2e7"1, 
then 
D[Y2(¢)] = 4(5 + (1 — 2r)e"% + (3 = ze" Ee | 


+ Qe-' — e~*)?D[Y,(0)] + e-% — 2e~')?D[Y1(0)] 
+ 2(2e7§ — e7 **)\(2e~** — 2e ky, co, voor 
D[Y.(0.5)] = 0.624. 
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35.24 D[Y,(r)] = ar ee (are + 4¢- 20) st 
2 9 3 

i 5S\,-2 4 (Ll. 21,, 23). 
+ (50 2+ Ze + (5 6*+ tos}? 

D[Y.(4)] = 3 na = (322 — 6¢ + 14)e7% 

. 2 27 

8 20 89 
De —2t a eS oe —_j. 
+ (2t 4t + Ie + (5 ee + 3) 


35.25 D[Y,(0.5)] = 0.01078, D[Y.(0.5)} = 0.00150. 
35.26 Since Y(t) and Z(t) can be assumed stationary, 





2 2 ,,,2 2 
oe a*a02w + §@)'= $= —_{ 
wb*(w? + o2)( wu" + | mb*(w? + 0) (w* + #) 
which after integration leads to 
a’ao2 ee 
DIVO! = Tape Ty | POI aed 


35.27, A normal law with parameters y = 0, o, = 0.78. 


4 fo} 
35.28 S.(w) = 2 { u's.) + | WiS;,(w1)Se(w — a) dw, 


ie 2 i OR Cee TEC Te 


ao 


re i © @ = ws*So(w = an)o?Sy(or) der 
: | © Sylw = o)02Sy(w:) der 
+4[" © - epetsy(o - 0)S4(0,) das| 

+ p [o*su(a) + |" @ = antsow — oSiws) de 
+4 I © @ = wr)*Solw = an)02So(ws) der 
+4 [7 @ ~ antarsi(w ~ w)So) des] 


nt nt 
Sw) = ze w*[S:,(w) + pxw? Sy(w)); Sxy(w) = zB? Pxpzw*Sy(w). 


35.29 To find the asymmetry and the excess, one should determine the moments 
of Y(t) up to and including the fourth. To find these moments it is necessary to 
find the expectations: 

MLX7(¢,).X7(¢2)], M[X7(t1)X7(t2)X7(t3)] and = M[X2(t,)X?(te)X7(t3) X7(t4)], 
for the determination of which one should take the derivatives of corresponding 
orders of the characteristic function of the system of normal random variables. 
For example, 

be 2 2 o* Il < 
M[X%(t,)X7(t2)] = bu? Ou2 {exp [-3,> kau S 


t=1 


> 
uy =ug=0 
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where ||kj|| is the correlation matrix of the system of random variables X(t1), 
X(t1), X(te), X (te). 
M[X2(t,)X%(t2)] = 2Kx(t2 — 1) + Kz(0); 
M[X?(t1) X7(t2) X(ts)] 
= K3(0) + 2K2(t. — t1)Kx(O) + 2K2(ts — te)K,(0) + 2Ki(ts — t1)K,(0) 
+ 8K(te — ti) Kx(t3 — 1) K(ts — te); 
M[X?(t1) X7(t2) X (ta) X7(ta)] 
= Kz(0) + 2K2(0)[Ki(ts — ta) + Ki(t2 — ta) + Kilt, — ti) 
+ Ki(ts — te) + Ki(ta — th) + Kits — 41)] 
+ 4[K2(t2 — t1)K2(ta — ts) + Kilts — th) Ki(ts — te) 
+ Kit, — hy) Kk(ts — t2)] 
+ 8K,,(0)[K.(t3 — te)Kx(ta — te)K2(ta — ts) 
+ K(t, — ts)K(ti — ta)Ka(ta — ts) 
+ K,(te — t1)Ki(te — ta)K;(ta — th) 
+ K.(t3 — O)K.(ts — t2)Kx(te — t)] 
+ 16[K,(t, — te)Ki(t1 — t3)Kx(t2 — ta) Kx(ts — ta) 
+ Kite — th) Ki(t1 — ta) Ki(te — t3)K(ts — ta) 
+ K,(ty — t3)Kx(t1 — ta) Kite — t3)Kx(te — t4)]. 
Substituting the obtained expressions in the general formulas for moments of 
the solution of a differential equation, we get 


2 ae ea eaeeet 
Se ara V2kK(k + 2a); Ex= | 


35.30 For 7 > 0, we shall have 
R,2A7) = 27(ki kc)” en het 2wo(hy + he) COS WaT — [w3 _ wi — (hy + he)? sin WaT . 


15k? + 25ko + 20? _ 
(k + a)(3k + 2a) 


ay) [(w2 — wy)? + (hr + he)? I[(we + 1)? + (Ar + he)?] ? 
and for; < 0, 
2 
Ryg(r) = 22 Eahne” 
1 


i 2a3(hy + he) cos wyr + [(w2 — w?) + (Ay + Ae)?] sin ait 
[(we — @y)? + (hy + he)? M[(w2 + @1)? + (Ar + fe)?7] 


w= VIER, os = VAR. 


xe 


oT 


36. OPTIMAL DYNAMICAL SYSTEMS 
36.1 Determining K,.(7) as a correlation function of a sum of correlated ran- 
dom functions and applying to the resulting equality a Fourier inversion, we get 
S.(w) = S,(w) + Sy(w) + Sur(w) + Si(@). 
36.2 Sw) = iw[S,(w) + Sy.(w)]. 36.3 L(iw) = iwe~'**, D[e(t)] = 0. 


; ia? 
36-4 Mio) = Bars BP + Pe? + ao 


x {(o* 4 B?)e~ tor _ @ — eo — py 


: m— in + l 2Zo-(timr . 
x G - in(Z= 2+ #) (w + m + in) 
m— In — la@ 
m + in — iB\? 
m+in + ia 


+ (m+ im 
x e MEME) — m + in| 
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where 
fe a aia a ee 
_ OB? + ba? __ ab |B? = a2] 
Ce Be "= a? + 6? 
_\ _ a (% + Bw — iB) 
36.5 L(iw) eZ © (a + dw — id)’ 
where 
CH VETR, d= 2 Vase + Bee. 
36.6 Dfe(r)] = | ” IN(iw)|2Sy (co) deo 
= [7 [eeiay)*15s(0) + Siw) + Sew) + S¥(0)] deo 
m+in w+t+m-s—in 
ob T= oe lm + i(n + nm)? - m? (w — my, — iny)(w + my — In) 
- —m+ in 
[m — i(n + ny)? — mi? 
wO- m— 
*(@—m — int@ yf m, — in)f° 
where 
n= VVB4 AB 


m= VEEP OP, 


2 2 
i cael m= [6 oe ace rene 2 
5 B Y 4c? B 1 ty + 73 B?: 
A2 


Diy = = - HS, [S + Im m(*)], 





where 
= m+ in ; 
— (n + m)?] + 2im(n + ny) 


36.9 L(iw) = e~"[iwr + (1 + 7)]. 


{ooo = (1-5) se 


+ i[QB — «) sin Br — acos Br]}; 


[m? — mi 


36.8 L(iw) = e~%, 





e7 At 
36.10 L(iw) = “— 


D[e(7)] = a ce or - i Br — (1 _ 5) sin po] 
meee ee Br + (1 - 22) sin prt. 





= se 
: a(a + B) ,- ,o — ip 
36.11 Liiw) = Ad + ay rae 3 
where 
N c= age + b?, q@= 5 (ap? 2 b?a?), 
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2 — B) —dto —_? 
36.12 L(iw) = Har TBR {(w* 4 prentaro — 5 el — fale _ ©} 


3 


where 
d la 2 ao2 
a= = (aor ale Bo?), b? = ie (Bor + ao?), C= —. 


36.13 L(iw) = e-*(cos er + sin pt + ic sin cr). 


36.14 L(iw) = Fens e~ oe tt[B — i(a — y)Kw — B — ia) 


+ elofB + ia — yw + BX ie)}. 


Dic(t)] = [18 + n3(a2 + f2)J03 — 2a nan |]? — Im (<. eal 
where 


2 
gris 208 ca? + B)n2, y i e~ @- B08 + ia — iy), y= a 
wT 2B Ne 


36.15 The Tequired quantity is characterized by the standard deviation of the 
error of the optimal dynamical system of 1.67, 0.738, 0.0627 m./sec., respectively 


Oo, = 20, ; ae ee 
T(2 + 607 + a?T?) 


36.16 Df[e(t)] = 40202d, where 





> y= a, 


which gives for o, the values 1.62, 0.829, 0.0846 m./sec. 
2|c.|? i 2c, 
ot B2 + (@ + a)? 


36.17 D[e(t)] = of(a? + 2) — 74 = {s ‘ 
x [Bb’ = (a + c)a'l}, 





where 
2 2 
oye 2oga(a? + B?) 
2 FrM%, 6 
a? = : es Pode +f). k? = ofa,k?; 
7 ora, 


ay 
Cy. SS oe Se ee Se 
: (a + cs) + BiB? + (@% — a’ 
Bia eee at weet te ee 


~ 2B(B+ ia + io (PB + ia + 7B:)(B + te — icy) 
2 2 e k? 2\ 2 2 22+ 
a? — B + 5+ J(e-e+4) — (a? + BP? — Keon; 


ee 
oe 


Ry 
I 


T 
m 
I 
R 

to 
wen) 
iS) 
+ 
| 
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(w? + «?)? 
B Y AL da _ 2-toT 
eh. (ede) ie we © 


a fore (EAeT st) + MEME _ Ul} 





2 


a+iw (a+ iw)? ta = 
— je)? 
é eae [BoB — y + 2ady — re — iw(B + Ad] 
Fry \2 
a (w i” e~ Te-*Tla(B + yT) + y) + 20(Ar + AT) 
1e4 
+ dg + iw[(B + yT)e~2? + Or + AT)B, 
where 
ee Min —B) & 5s = —0.015202 sec. -?, 
2T 
4[aus —oB+yt > = p| 
dg = = - 0.0112 see. ~?, 


our 4 02T? + 4aT +4 


Hi = 1, H2 = To» B _ (1 + aro)e~ 70, ia ae 0; 
D[e(t)] = oa[t + Apr + Agus — B (20g — 2y + aAy — dg) 


-2+ | = 0.4525. 


36.19 The general formula for L(iw) is the same as in the preceding problem 
except that 
f1=0, peo=1; B= are -%; y = —o2e-%o; 


A, = 4.58-10-3; 2 = —2.54-1074; 
D[e(t)] = ote + Aspe — B (np — 2y + ad; — do) 


a x (y+ »)| = 0.0110 sec. -?. 
36.20 U(r) = 8(7), D[e(t)] = 0. 
36.21 For the first system 
L(iw) = [(w? + a? — B)? + 40282] 
% {% rz Ag + iAg Ag Dy 


in w 2QQ—w) ' AQ+a) _ 
Ay + AQT Ag A3 + id, Ag — Ide 
. | or oe Oe 2(Q + w) © orl 
— [w? — (@? + B?) — iow] [2a(rAr + As) — Ay — AgQ — IA, + Ada] 
— e- Tay? — (a? + B?) + iow][2c(Ar + AvT + Ags sin QT + A, cos QT) 
+ de + AgQ cos OT — AO sin OT + iw(Ay + AT 
+ Agsin OT + A, cos QT), 
the constants 1, A2, As, and Aq are determined from the system 
Ar + 10Aq + 0.1244A2 + 0.9903A, = 0.000578, 
Ar + 13.4034. + 0.17283 + 0.9620, = 0, 
. A, — 0.8752dr2g + 0.1657A3 + 0.9837A, = 0, 
Ar + 10.1831A2 + 0.12363 + 0.9889, = 0.000584, 


ear 
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which has the solutions: A, = —0.0018, A. = 0.000011, Az = —0.0106, Az = 0.0036. 
The variance for the optimal system of first type is D[e(t)] = 0.135-10-*. For the 
second system, the form of L(iw) remains the same but Ay = Ag = 0, and Ag, A, are 
determined from the system 


A3 + 5.937A, = 0, 
As + 8.003A, = 0.0047, 
which leads to A3 = — 0.0136, A, = 0.0023. The variance for this system is 
D[e(t)] = 0.266-10-*. 
e~2, Dfe(t)] = (1 — e7?%*)o2. 


a 1 


e-*(cos Br + B sin pr); b= B e~** sin Br; 


36.22 a 


36.23 a 





2 
D[e(z)] = o2]1 — e724 1 + 25 sin Br cos Br + 2S sin? Br)|. 
[e()] 7 5 
Ou at 2 Cu ~2at, 
36.24 Os gt foo 0, DleO) = gal or ge o}. 
2. 
36.25 a=-— ae e~*to sin Bro = —0.09721 sec.~}, 
b= e~*e(cos Bt — 3 sin pro) = 0.9736, 
c= 0, Dle(rt)] = 0.404 deg.?/sec.?. 
36.26 a= e-*e(cos Bro + 3 sin Bro) = 0.99, 


b= aoe sin Bto = 0.20 sec., c= 0. 


37. THE METHOD OF ENVELOPES 
T 
37.1 K,(7) = 9% [Ea — gq?) — @K(1 — gq?) — 5| : 


where g=1- k2(r) — r(r)3 K(z7) = eel, 


i T 
sinw7T 1, 


1 
2 = —at By — e@t Bi (— . 
rea) = 2 [SRE des = 5 le Ei (er) ~ e Bi (—an)]; 


Ei (x) denotes the integral exponential function. 
“ et 
BQ = [oS du. 


37.2 Since 203 


2 a 
S,(w) = ox mw? + a2” 
we have w, = 2a/7, w2 = % 


2: P(d 1 2 
* 1 = ; ®<0)+- es ES 
P(D 20)= 3 (1 + 2) Date ( ) 2 (1 2) 0.182 


are independent of «. 
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oun P(® 2 D= [2 a a Va? + B? (5 + arctan elias “\); 


2 2a8 





pb < y= 5 |1- va +h (§ + arctan ="). 


37.4 P = 0.5 and are independent of a/8. 


37.6 The phase is uniformly distributed over the interval [0, 27]. 
2 2 2 _ ,2\2 
(a? + B?) [ = (5 + arctan B . 


37.5 f(¢) = 














: 2 2a8 
37.7 ae , + BF (am | Oy se |g 
~ ap 3 arcta Zap 
2 2 2 72\2 3/2 
rear pene i fd pete: 
+(e +8 ft Be (5 + arctan Fop | 
: a 1 a? 
37.8 f(a, 4) = ———~=— exp ] - 53 |? + ay eer 
wo V2n | — oe i o°( — 5) 
WT Ww 


37.9 Since k(t) = e7"I(1 + ajz|), k(2) = 0.982, 


= 2 203 : 2 eee : 
r(2) => 7a mw? + a2) sin 2w dw = 7 [1.2e Ei (0.2) — 0.8 Ei (—0.2)] 











= 0.122, 
then 
48.08a 24.04a2 a 
f(@z | a, = ox) = oe xP {- of 2 23.2} Ip (47.56 as). 
37.10 Since 
2 42 _ 2 _ (2 2 _ o@ + B? (a B?2 — a?\?] 
A we — wi = (e? + B yf a 3 + arctan ZaB = 0.0089, 


A _ 00135 « 1, 
Ww 


2 
the following formula is useful 


4.457-10-3 
fo) ® = 


2 
al 0.693) + 89-10-9| 


= 
0.0417 
al (7 2 3/2 
ca 6 ls 0.647} + 0.0814 


37.12 The required average number of passages equals the probability of 
occurrence of one passage per unit time 


37.11 f(r) = 


20 oe 
p= (ee e-? = 0.083a sec.-?. 


* 37.13 0.0424a sec.-?. 
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q 1 K 7 2 
37.14 S(G2 $1) = mn {+3 + Gd — 2pe E + arcsin “|}. 
where 
2 2 2\ -1 
q? = 1 — k*(7) — r(7); T= at (5 + arctan Ca | = 4,53 sec.; 


a? + B oB 





= . BB Ss oe RB ee 

k(7) = —0.95; r(r) = 2 I m(w? + a2 — p?)? + 40.282] 
k= VI — q? cos (%2 — y); y = 179°; 

D[X(¢ + 7)] = M[42]M[cos? ®] — {M[A]M[cos 9]}?; 


sin wr dr; 





2n 22 
Micos 1 = |" fps | 1) cos 72 dpa; MIcos* ] = [™ sip | ps) cos? ys de. 
0 


37.15 R,.,(7) = 203 { S,{w) sin wr dw 
o 


_ Qala? + B?)o% [* sin wr do 
< T F (w? 7, p + a2)? + 40:28? . 


VIII MARKOV PROCESSES 


38. MARKOV CHAINS 
38.1 It follows from the equality A*** = Ar7*, 
38.2 p(3) = R’p(0), where 
R= PPPs = |r); ry = 11 = fae = ras = af + a2 + 03 + 6a cou; 
ro = Nie = rai = Fea = Bato, + agag + 0105); 
rg = lig = far = rao = 3(o%102 + ajag + a2c§); 
P(3) = {rie + rab + rey; roa + iB + ray; rat + rep + ry}. 


38.3 States: Q, means that all competitions are won, Q2 means that there is 


one tie, Qs; means that a sportsman is eliminated from the competitions. By the 


= = ae _ = (nr) _ = 
Perron formula, p$? = p$? = pS? = 0, p& = 1, pf? = a", pR = y", pR=1-y¥, 
(mn) _ 1 (n) _ p(n) 
Piz = Pir Pig, 





at — y" 
B for y #a, 

PY = ae 4 
no" —+ for y= a. 


38.4 States: Q, means that the device is in good repair, Q2 means that the 
blocking system is out of order, Q3 means that the device does not operate; 
pe =p =p#R=0, pip =(-a-f", pR=(A-~y)", pP=1, 
pPae=1-(U-y)", pe =1—- pP — rR, 

a 
——,, [1 -—a« — fp" -(1-y)"] forat+BFy, 
py = dy-e—B B y By 


na(1 — y)"~} fora +B=y. 
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38.5 The state Q, (j = 0, 1, 2, 3) means that 7 members of a team participate 
In Competitions. For i < k, pi = 0G, k = 0,1, 2, 3), 
PSB=1, pR=a", PR=f", PR=y", PW=1- a", 


P# = Bi fl«,6), PR=1-PH-pR, pPR=yn/fb,y), 
PY? >= yof (a, y) as Biyiela, B, y); PS =1-— ps3 =, PS? a PS, 





where 
flab) =2 =, flaca) = nar, 
OL _ fa” — fB,y), ie es ws noo * ima ie 
pa, 8, y) = a — B ea, >) ry (— yy 


pa, a, «) = nin — 1)a"~?. 


38.6 Make use of Perron’s formula for single eigenvalues 
m 


Me = De (K =0,1,...,.m, [AC - Al =TT A->p,). 
v=0 
For i > k, A(A) = 0, 


= |Ae _ P| 
Fork > i, 
[AF = P| DyalA) 
Aya) = —-———— : 
uA) = "THE — py) 


38.7 Use Perron’s formula when the eigenvalue A = p has multiplicity m, 
and the eigenvalue A = 1 is not multiple. 


AE — Pl = A= PPA-—D; — Ama(A) = PS= A: 
_ |Ae - P| _ 7 
AUN a (k = 0, 1,...,™ 1). 
Ford Ske AL = 0: 
Am(X) = AE 21D add 


(A — py" — 1) 
Fork >i,k # m, 
[Ae _ P| DislA) 
“(X — pyerttt : 
38.8 The state Q, means that there are j white balls in the urn after the drawings. 
For j > i, py = 0; for i > J, 


Ajg(A) = 


Chicgs? 
Py = cee 3 a 
The eigenvalues Ay = 1, Ax = Ch_»/Ch (kK = 1,2,...,m) are not multiple. The 
transposed matrix # is upper triangular; the probabilities p{” are determined by 
the formulas from the hypothesis of Problem 38.6. For N = 6, m = 3, 


1 

PSY = PH = p& = ph = pw = pw=0, pw=1, PY = = 
1 1 1 i 1 

PR = 5 PS = x0" pe =1—- an” PR =1—- ani + 5n’ 
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38.9 State Q,; means that the maximal number of points is N + j; py = i/m, 
py = Ofori > Jj; Py = 1/m fori < j (see Example 38.1); 
ae . k\" k — 1\" ; 
PP = (=) ; PP =0 for i>k; PR = (=) = (—*) for i<k. 
38.10 The state Q, means that / cylinders (j = 0, 1,..., m) remained on the 
segment of length L. The probability that the ball hits a cylinder is ja, where 


2r+ R ‘ ; 
= a Py3,j7-1 = I®%, Dy = 1 — ja, Px = 9 


for i1#j7 and 1#/j-—1 @j =0,1,...,m). The eigenvalues A, = 1 — ka 
(k = 0,1,..., m), piP Ook ok Fort ok. 
! € - 
An(d) = af-# DAS — FI 


kK! [T[b-n A — 1 + va) 
By Perron’s formula for i > k, we have 


ee AMA — Aj) i! & (-1)-*"d —- ja)” 
pi =a k! a Freee al lacy 7 aoe G-A!IG-y/! 


crs (ich all — & + val. 
v=0 


38.11 State Q, (j = 1, 2,...,m) means that the selected points are located 
in j parts of the region D; pj; = f/m, pj,441 = 1 — j/m. The Slecnvalucs 4, = r/m 
(yr = 1,2,..., m). From PH = Hi, it follows that hy, = (Ch4/Ch) (ae = 1); 
from H-12 = JH~™ and H-!H = @ it follows that Ai? = yc s, 
J = HJ"*H- a a 


Die = pS (=F (Ht = raiy Cit 


(for another solution see Problem 38.10). 
38.12 Set e = e?”/™, Then 


H= || sxe = JP DHE- DI], H-o= |ASe DI = = jen D1] 


P= A|d,rAR|H~*, 


where 
m 
Ne cee DO ESAS 2, na5ith). 
r=1 
pe = 2 5 mee-ve-9, pi 21 Gk = 1,2,...,m. 
5] m {o ’ m > 9» ’ 


38.13 Q, represents the state in which the particle is at point x,. 
i I ; 
Pit-1 = m Pii+1 = 1 — m (i = 0, Ly ven Mm) 


The matrix equation H~1# = ||6,,A,||H—+ is equivalent to the equations 


| — £7) Ri(€) = mA, i ORO, Gi = 0, 1, sees m), 


where 


Ri(é) = > ERE Y = C1 — &/20-40q) + Gym/2a +40, 
k=0 


Since R,(é) is a polynomial, the eigenvalues 4, = 1 — 2i/m (i = 0,1,..., m). 
From HH = é, it follows that é am De=0 by .€” — YF=0 hy RAE). Letting 


—<—— C; = 22m. 
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we find the elements /,, = hj; » of the matrices H = H~1 are given by the expression 
m 


S ag = > Wp PY = 2-9 — OL +O! @ =... m). 
j=0 


g=0 


The probabilities pi are the elements of the matrix 


2\, 
(1 z 2) o 


38.14 ©, describes a state in which the container of the vending machine 
contains j nickels. 
Poo = 9 Pmm = P, P3341 =P, Pij-1 = 9G = O,1,..., m). 
The eigenvalues are 


m= Hl 











ro = 1, Ay = 2V pq cos 





rei (A = 1,2,...,m). 


P= H|d.A,|H~*, 
hy = 1 GU =0,1,...,m), 


_ (a\? « _jka_ _[q\9*?? . G — Ika 
hy = ( sin ——— (2) sin me A 


G =0,1,...,m; k= 1,2,...,m), 
(-1) — p\* iz 
hox =e (k = 0,1,..., mm), 


k/2 o (k-—1)/2 = a 
AG? = al (2) sin Ue jz. (£) sin Cele De 





q m+1 q m 
VG = 1,2,..!,m; k =0,1,...,m). 
The constants C; are determined from the condition H-*H = @: 


ae | 
Pp 


a 
1- (7) 
q 


=. -1 
Cr = 2p 1 _ 2V pg cos ud (k a 1, Dykes) y 


Co = 








m+ 1 m+ 1 
PR = > hgh? = (i, k = 0,1,..., m). 
38.15 State Q: ieane fitine the target and Q2 means a failure; 
Pu=, Pa =f, pi) = xc + B), po(0)=1- 5 (@ + B), 


{pi(m); po(m)} = (F’)"{p10); p2(0)}. 
The eigenvalues are: A; = 1, Ag = a — B. By the Lagrange-Sylvester formula for 
he # 1, we get 
1 
Pr = iSere [PF —-(a@ — B/E —- @ — BYP — )], 
1 
pitt) = 2 eB) [28 + (1 — a — BX@ — By" +3], 
If A2 = 1, then 
1 
. P= é, pi(n) = oy 
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38.16 From df. 1p = 1, Yi pup! = ps? VG = 1,2,..., m), it follows 
that p§? = I/m Gj = 1, 2,. Mm). 
38.17 Q, describes the state in which the urn contains j white balls; 


2i@n — J) (m — j)? Z? : 
pie ar a Pij+. = “Ta? Es ee UV =0 1 ...y, Mm). 
The chain is irreducible and nonperiodic, piz? = p{§°. From the system 
PO? = PP 1Pie-142 + De Pe + Die 1 Pe tive (k = 0,1,...,™m), 
we get 
] m (CK)? 
DO = K)2p 6) | = k)2 — Cm (ao) p(o) _ Lem 
(Cr )?p DS” 2 (Cr) 2ms Pik = Pk Ch, 


(k = 0,1,..., m). 
38.18 Q, describes the state in which the particle is located at the midpoint of 
the jth interval of the segment; 
Pir =, Pam =P, P41 = Py Pg-1 =F =F = 1,2,..., m). 


The chain is irreducible and nonperiodic. The probabilities pj”? can be determined 
from the system 
gp? + gps = p\, 
PP in. + Pim? = Din?; 
PPE, + DED, = PE? (k = 2,3,...,m— 1). 
Then 


p\e-h m 
per = (2), 3 oe = 1. 


For p = q, p< = 1/mand for p # q, 


The probabilities p{£* can also be obtained from p{? as n-»> co (see Problem 38.14). 


38.19 The chain is irreducible and nonperiodic. From the system 


fea] 


» Up = Uy G=1,2,...), 


t=1 


it follows that 





Since 


@ « 

S. L 
4, 0+ 1)! 

there is a nonzero solution. We also have 


> |u;| = eT Saeed aa: 


mit 


= 1, 


that is, the chain is ergodic, 
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38.20 The chain is irreducible and nonperiodic. From the system 


> Uy Pig = Uy G = 1, 2) a ys 


t=1 


it follows that wu, = q dfi1 &, Uy = Uy p'—*. We also have 


> |u| 


consequently, the chain is ergodic; 


ed ge ae : 
uy > dD =— <O; 
g=1 q 


j-1,(7) 


BO =p 3p, pP=q, 


DP Sap > GS 1.2 2¢ 


38.21. The chain is irreducible and nonperiodic. From the system 


that is, 


ao 


> Uj pig = Uy G = 1, ne Ds 


J=1 
it follows that 


a a) oe ; = 
= 5G 1} UG =2,3,...). 
The series 


o 


Sioa alt + & ago 


g=1 


is divergent; that is, the chain is nonergodic. This is a null-regular chain for which 
pe = O0-k = 1; 24.25: 


38.22 Q, means that the particle is located at the point with coordinate 
jAG =1,2,...); 
Pu =1—e, pjjr1 = 4%, Pi+i = B, Py = 1 —o ae: = bears © 
The chain is irreducible and nonperiodic. From the system 3/21 4, py = u;, follows 
that uw, = (a/8)*-1u, (k = 1, 2,...). For («/B) < 1, we have 





ao 
> [Ml = —. <@ 
k=1 1= a 
B 
and, consequently, the chain is ergodic; 
k-1 

(0) _ 5) (@) (2) G. 
Pk —1s D > Pp Sh = 2? 
(j) P= 


that is, 


Pp = (3) (1 = 5) eo eee 


If «/8 > 1, the Markov chain is null-regular; p§f? = 0 Vj, k = 1,2,...). 
38.23 Since W" =0, psy = B-rpw? = 1 G=st+ 1,54 2,...,m). 
38.24 From the system 


m 
Pas =O) D2 Pav + B G=rt+1,r+2,...,m), 
we obtain 


B 


"Team oor Pie toe): 


an P 
Dx; 
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38.25 Q, represents the state in which player A has j dollars (j = 0, 1,..., m); 
Poo = 1, Pam = 1, Pys+1 = Ps Py3-1 = 9 GU = 1,2,...,m — 1). The probabilities 
Pai = DSo> Of ruin of player A are determined from the system 
Pai = PxoP + 4G, Px,m-1 = PDum-2> Pay = QPxj-1 + PPwj+1 
VU = 2,3,..., m— 2). 
Setting px; = a — b(g/p)’, we find for p # q that 


m—-j 
1- (7) 

Dsg = T7T) 
au, 
q 


and for p = q that py; = 1 — j/m GY = 1,2,..., m — 1). The probabilities of ruin 
of B are px(B) = 1 — ps A). Another solution of this problem may be obtained 
from the expression for pS@? as n —> co (see Example 38.2). 


38.26 H = |hyxl| = |le%-P*-], where ¢ = e2™, Then PH = H|Sy.dxl|, 
where A, = e*-1 (k = 1, 2,..., m). Since |A,| = 1, the period « = m, 


Hoel Je" F-DE- DH, 
m 


1 


m 
_ -1 +j-k)- 
pP=— gD tI-1), 


mM 4 


that is, p§P = 1 if n +7 —&k is divisible by m and p{? = 0 otherwise (j, k = 














be2e3 te pyt* = Lifr + j —k is divisible by m and piy"*” = 0 otherwise 
(r = 0, re ,m— . 
A ater 1 , 
Pik = < im "S, pane? = Gk Hy 2scts ms 
a” U, 
38.27 Pr = 5 PP -Al=A-OO?-1), A=], 
QO R” 
Ag = a, A3 = &, Ae = €7, 


where « = e2”/3. The period « = 3. For j, k = 2,3,4; pRP =1 ifn+j—k is 
divisible by 3 and pS = 0 otherwise. By the Perron formula, 


1 _ a(@B + od + y) , er Be? + de + y) _ eT M(Bet + Se? + 7), 


a ta 1 - 2 (@—e(1—e? 3(a — &”) 
im 1 _ aay + oB + 8) | et ye? + Be + 8) eo Mye* + Be? + y) 
PS 37 Toe G@ e-POD 
| a(a2d + ay + B) e”—1(8e? + ye + B) e2n-1(Se4 + ye? + 8) 
Pia = 3 T— a3 ae aay Bee 
= 1— a — pQ — rR, 
Bir a 5 lim (p93? + pr») + pS" *?], 


Pu =0 G=1234, Prox k= 2345751234). 


38.28 The chain is irreducible and periodic with period « = 2. The first 
group consists of states with odd numbers and the second, those with even numbers. 
Then lim,z+o pS” = px and lim,_-. p3"*+? = 0 if 7 + & is an even number, and 
lim, +0 pP&™ = 0, limzso pi" *? = p, if 7 + k is an odd number. The mean limiting 
absolute probabilities p, = 1/2m (k = 1,2,...,2m) are determined from the 
equality PP = P, Pe = Px. 
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38.29 Q, describes the state in which the particle is at point x,(j = 0,1,...,m); 
Po. = 1, Pmm-1 = 1, Pjyei = Ps3-1 = 9 G=1,2,...,m— 1). The chain is 
irreducible and periodic with period k = 2; gp; = Po, Bo + Qp2 = Pi, PPm-2 + Bn = 


Bm-1) PPm-1 = Pm, PPe-1 + Qbx+1 = Be (K = 1,2,..., m — 1). For p # q, we have 
ae 5 eee 
och eg . _1(p\nt_| 4 
Po~5 (ey Pm = 5 q ey 
1-(2 po (2 
q 
ee 
. 1 zy q 
Ee ae 4 Geenan: Re ey ee ee 
Pr iG 1 - (2)" ( ) 
q 


For p = q, we have fp; = pm = 1/2m, p, = 1/m (kK = 1,2,..., m — 1). 


39. THE MARKOV PROCESSES WITH A DISCRETE NUMBER OF STATES 


39.1 P,(t) = ent OE 
362: py = poe eA TAD, 
n> 
39.3 P,(t) = wor eA, 


where A(t) = Af) [1 — F()] dx; 
pa = lim P,(t) = YO e-x, 
t+ 0 nt 


where 7 = [5° [1 — F(x)] dx is the expected flight time of the electron. 


t 
ee ie 








39.5 
FAO = 4) > ae if +> 0, 
0 if ¢ < 0; 
fit) = me if 1 >0, 
0 if 1 <0; 
m, = Mat D+ k—~V. 


39.6 Solving the first system of equations 


dP y(t 
SPudE) AP y(t) + Pia 
for initial conditions Py(0) = 6, by induction from P;,,+1(¢) to P;,(t), we obtain: 
Cae 


Py{t) = G@— k)! 
0 if k > i, 


if O<k <i, 
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39.7 For A = p, the inequality 





gives m = 4. 


39.8 The system of equations for the limiting probabilities p,: 


MADo = FP1 
[(m — na + Pn = Un = 1)Apn-1 + HPn+1?> 
HDm = APm-1 


has the solutions 
= m! A m 
Pu =m — nyt \p) P? 
where po is determined by the condition >7-o p, = 1. The expected number of 


machines in the waiting line is 


A+ 
A 





Ly=m- Epo 


39.9 The system of equations for the limiting probabilities p, is: 


Mo = EP1 
(nm — nA t+ nlp, = (m — 1 + WApa-1 + (t+ Ippasi for len<r 
[(m — nA + rp] pr = (m — n + I)Apa-1 + rena for r<n<m—I1{- 
YEDm = Pm-1 
and it has the solutions: 
Tai (7)"r. if l<nr, 
Pra = 
m! A\” ; 
r*-r!(m — ny! (2) Ron Mats 


the expected number of machines in the waiting line for repairs is 


m! 2 n—r A\” 
L, = —— Sa ee 
a= Povy PH rim — ny)! () 


39.10 The probability that the computer runs is the limiting probability that 
there are no calls for service in the system po = e~*/*, where p is the average number 
of repairs per hour. The expected efficiency resulting from application of more 
reliable elements during 1000 hours of operation is 


6 = [2 + 1000¢( 1 — exp {—h)] — [2 + 1000¢( 1 - exp {~2\)] 
be Le 
= 16lc — (6 - a). 
39.11 (a) The system of equations for the limiting probabilities 
APo = HP1 
(A + ke) pe = Ape-1 + (A + Wpepesr US k <n), 
(A + np) Pe = ADe-1 + ABPK +1 (k 2 n) 
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has the solutions: 


k 
a (2) for l<k«<n, 
Pu = 1 aie 
—— |- > 
nink=™ (2) Po for k n, 


where po is the probability that all devices need no service and can be determined 
from the condition >=0 Px. = 1; 


rm=t 1 (A\* be eyy" 
= —{5) + — [= 
ae { k} (3) (a — 1)' (np — A) \e 
with the condition that A < np. 
ee eee 2: eee 6 _ ve 
Pr 2 De (7) ir be PO 2 Po 


where P,(7 > t) is the probability that the waiting time in the line is longer than 1 if 
there are & calls for service in the system: 

k=? (unt)! 

PAT > t)= >; me en unt 

j=0 : 

Substituting this value, we get 
= ko? (unt) 
1-— F(t) = By Pr oe eo unt: 
k=n j=0 J 

since py/pn = (A/np)*—", changing the order of summation we obtain as a result, 


7 © ry © ( x os NLDn = = 

1 — F(t) = pre~4™ — — = — TER o-(nu-nt 
os oe J) Stay We ne — x 

and, since p,/p* = 1 — (A/np), then F(t) = 1 — p*e~™~-™* (for t > 0); 


oo * 
i=-| tdF(t) = Pp “A 


) ny 





I 


(d) my 


= k=0 


= eo a\k d 
> ke - pe = pr > K(*) = pr 
k=n Be nu( —_ ) 


= n — \ A\* 
m= > koe = my +P + po Satay, (4): 


k=1 pee k=1 
ny 
n-1 Ml pn — k [r\¥ 
ms = > (n— k)pe = vo Y, n* (2) : 
k=0 k=0 . B 


39.12 Apply the formulas of Problem 39.11; ¢ = 2/115 hours. 
39.13 Select x so that pte“ ““—-™” < 0.01; n = 4 (see Problem 39.11). 


39.14 (a) The system of equations for the limiting probabilities 


ADo = BP 
: QA + ke) pe = APe-1 + (K+ VDpepesi GA < k <n) 
(A + np) De = APe-1 + NBDE +1 (n<k<1-1) 


APi-1 ALP) 


ANSWERS AND SOLUTIONS 


where / = n + mhas the solutions 


p° A\* . 
(2) if l<k<n, 


k 
was (3) ifn<k<l, 
nln iy 


where po is the probability that there are no calls for service in the system; 


Po = 


Ag KI Np al\p a 


“ 
np. 


xr m+1y-—-1 
1 ee peas 
Pea aya 
1 
(b) the probability of refusal 


Sr5 Di 
Pal (*) 


(c) the probability that all devices are busy is 


where 





@ $0 60222255 ew i(2) S (2 y) (> 0). 


fe ny mtl ma 7 np. 
ny 


- Pn A _ a» m+1 aA mt+2 : 
(e) m = 7, . 2) mrt E (m + »(>) +m ii ; 
ny 
rA mt+i1 
eer eee (=) i ee 2" 
M2 >= my, ; _ Xx APn Po A (k io 1)! Le > 
ny 
nly —k (2) 
Mz = | ‘ 
3 2. k! be Po 
81 32 _ 52 _ 264 1550 


39.15 Po = my, m2 > 


665° 7 665° PF 733” ~ 665° “665, 
39.16 The system of equations for the limiting probabilities 
MApPo = LP1 
[(m — n)A + nlp, = (m — 2 + 1)Apa-1 + (+ Wpepnsi?, 


MEPm = ADPm-1 


= n Bh mn ft. 3 a 
p= CHF) Ga) 


39.17 The system of equations for the probabilities P,(z): 


aPolt) = —ndP,(t) + (n — 1)APp-a(t) 


has the solutions 





for initial conditions P,(0) = 6,; has the solution P,(f) = e~*(1 — e7~*)*-1, 


455 


~ 2.33. 
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39.18 The systems of equations 


ee = pP\(t), 
oe = —n(a + p)Pr(t) + (a — WAPa-1(t) + (2 + DePaailt) (a 2 1) 


for initial conditions P,(0) = 5,; is solved with the aid of the generating function 
G(t, u) = >So P,(t)u"; G(t, u) satisfies the differential equation 
OG(t, u) _ éG(t, 4) 
3, eS DEK) 
with the initial condition G(O, uv) = u. It has the solution 
pe + ull — (A+ wk) 





ee rae 
where 
1—- er — wet . 
re ea 
K= 
t . 
1+ pt aa 


thus, it follows that 
Pot) = pe, Prt) = (1 — Aw) — px)Qnr-* (nv BD). 
39.19 The system of equations 


aot} = — Ao(t) Po(t) 
= = —AW(D)Pr(t) + An-1()Pa-i(t) (n> 1) 


with the initial condition P,(0) = 5,5 has the solutions: Po(t) = (1 + at)-/%, 


(+ a)(_ + 2a)---[1 + @— Ja) 


Ppt) = "1 + ato erm “1 


40. CONTINUOUS MARKOV PROCESSES 


40.1 aj(t, x1, X2,..., Xn) = Wit, X1, X2,---5 Xn) 
bylt, X1, X2,.- +, Xn) = Pt, X1, X2,.--, Xnpilt, X1, X2y-~ +, Xn). 
40:2 ah, X53) = Pass Os - FS eo, 
GQn+1 = Xn423 Anza = Xn+33  Gnag = —O°Xn+1 — 3a? Xn42 — Jarxqe3;} 
bn+a.n+3 = c*, 
the remaining b,, = 0. 


40.3 U(t) = U,(t) is the component of a two-dimensional Markov process 
for which a; = Xo, 


az = —(a? + B?)x, — 2axe, buy = c?, big = —2ac?, bog = 4a?c?. 
40.4 a(t, X1,..., Xn) = pit, X1,---,%n)3) bp = Wall, X41, ~~, Xn). 
40.5 The Markov process has r + n dimensions; 
ay = P(t, X1,...,%), J = 1,2,...,73 Qery=xtlti, l=1,2,...,n-15 


n 
Qr4n = 2 Crin+1—j%j5 Deeg se = Cr+ pCriq; Pqr=n—-m,...,n, 
j= 


the other by = 0; here Crak = Disa = > ae Oe —7Cp 4 ye 
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1 1 oss 1 K 
R ,=- — V/ 2&1 . 2=- — bo : 
40.7 U U2 + 2U2 £1(t); U. (U1) + — €2(t) 


where £,(t) and &.(t) are mutually independent random functions with the property 
of “‘ white noise.” 


a? vy a? 
40.8 f(1, Yo) = Cc exp {-5 ia y(n) dn — ale 


where c is determined from the conditions of normalization. For p(u) = B?u 


a8? 4 a -1 20? Via . né 
= eo ca Ween = — “™ dn. 
f cs exp { do zi IG ZI2¢> Cy a Veep 4g 4) 


ws w= gharlal 9} 


where c is determined from the condition {™, f(y) dy = 1. 


40.10 Setting U, = C(t), U. = U, — U, for U2 we find an equation that is 
independent of U,. The Kolmogorov equation for U2 will be 


oe a be Of 
ar ie {lae + c FO} - 2 TRC oy} 
and its stationary solution is: 
27R [¥2 
f(y2) = cexp {-5.93 - a | F() an, 
Cg Cc 0 
where c is determined from the condition of normalization. The required probability 


density f(y) is the convolution of f(y.) and the normal distribution law with zero 
expectation. In the particular case 





2 WRk 
fr) = cexp { - OP SF 504d - sen va} 
where 
2V1+kR 


q = 


ol + VI + ER) 
C1 1 _ u = Tu? 
fw = V2 {7 + 27 ! 0(— + =)| exp{ (27 + na} 


a : + [==] 
V2a + 2nkR +1 oV20 + 2nkR + 1 
m1 + kR)u2 } 
xX exp < ——=—— TS 


(27 + 2n7kR + 1)c? 
___%” aa Or — Ne 
40.11 f(r, ¥) = aa* + ta? exp { 2(aa? + x} 
40.12 The re equation for U = exp Poe has the form 


of _ ak: - wars dig\? een 


The stationary solution is: 


RC 1 : 
f(y) = N7* exp ~ (GigR)2a2 [>*(n y= : = 2aigRe-or*y] |, 





where 5 
of = e071 E\(— 202) — 2 nao — 0.57721-- -] 


(compare Stratonovich, 1961, p. 243). 
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40.13 f(y) = c exp {-% [ Pm) an. 


where 
foe) 2 yu 
Che I ox {-3 | Pm) an} dy. 
—-o CG fey 


40.14 The Kolmogorov equation is: 


L 4 2 lols) + BOA — 5 Fa VEN = 0: 


the equation for a characteris function E(r, z) is: 


1 
a — iza(r)E — Ba) = + a 2E=0, E(r, z) = exp {-5 o2z? + ish, 


y = exp {f B(r1) ar,\{x + [ exp [- | B(71) ar,| o(T2) ars} ; 
o3 = I “exp { a i * Br) ar,} (49) dra. 


40.15 The Kolmogorov equation is: 
f 12 _ lige PF _ a. Beta 
a Tey 3 Tae FH i cas ae ae 


es j2 b. 
p= xexp{-2 ‘} o2 = [ — exp { 2 ON. 


40.16 Setting U,(r) = U(r), U2(t) = U,(t), we find that the coefficients of the 
Kolmogorov equation are: 














QA, = Xa; az = —2hxe = kx; bi = 0; bio = 0; 
1 i= ae 
= —— eX — ++ _}, 
f(r, va) a= P{ 2a? 


h. 
fi = xe“*°-0L 0s @o(r — t) + —sin wo (7 — | 
Wo 


= “2s 
bes = Cc; 





where 





gs c? {= Las en 2h) + Lae e- 2*1(h cos? wod1 — wa Sin 2woe3) >: 
1 Fhe we we eee 
ma=7T-0; wo = VEF — hi. 


40.17 2 - a5 (sen je a6 


Or 2 dy? 
40.18 f(t, i (Bey xe aes QnBt ,— By2/a2 ni 
x; ~ WnBtp— ee 
tnd a? a 22 - Ta + 2u 4+ 1) 
x2 2. 
x igo ( Fe) z0(B, 
where 


—~ijzv 1! 
iro (2 3} 
and L$”(x) are the generalized Laguerre polynomials. 


B 
40.19 W(T) = | w(aT, yi) dyi; 
-B 


x 


2 1 
w(71, ¥1) = > exp {— Afri} exp {-4 Ah Denes 


7=1 
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where D,(x) is an even solution of the Weber equation? (the parabolic cylinder 
function): 


2 
Ta + (G7 - ay = 0; 4? = a; — 0.5; 





dx? 
a; is a root of the equation D,(8) = 0, 71 = a7; 
sd Ve y, B= = Uo, Gy = = ¥ - Das(0); 
Ny = |? exp {-tyho op(3) As. 
40.20 W(T) = i w(aT, y1) dyi3 


& 1 
w(71, 1) = > exp {—AFri} exp {-3 vi} Viney, 


j=l 
where 


1 : 1 1 
a{2 1/4 (1), ats _ 
V(x) = a 27 {2- ! rj - — 5.4) Ds (x) sinn(§ + 5a) 
See | 1 1 
1/4 psa ea (2) = = 5 
+2 ri 5 a) Df (2) cos a(j + 4)}s 


D?(x) and D(x) are the even and odd solutions of the Weber equation?: 


1 2 — . 
we + (G — a) = 0; 
a, is the root of the equation V.,(8) = 0; A? = a; — 0.5; 71 = a7; 


V 20 V 20 Va 1 
way B = —> wo; a= i V.,(0); 


= 1 
N= [ex {Sythe dn. 


IX METHODS OF DATA PROCESSING 


41. DETERMINATION OF THE MOMENTS OF RANDOM VARIABLES 
FROM EXPERIMENTAL DATA 
41.1. 10.58 m. 41.2 (a) 814.87 sq. m., (b) 921.86 sq. m. 
41.3 & = 424.73 m./sec., 6, = 8.84 m./sec. 
41.4 6 = 33 m_/sec., &, = 3.07 m/sec. 
41.5 = 404.85 sq. m., &, = 133 sq. m. 
41.6 For P(A) = 0.5, Dmax = 1/4n. 
2 


41.7 D[é?] = at) D°[X], Die_] = —*— D[X1. 


bret a 


ee 


2 See Tables of Weber Parabolic Cylinder Functions in Fletcher, A., ef a/.: An Index 
of Mathematical Tables. Vol. II. Oxford, England, Blackwell Scientific Publications, Ltd., 


1962. 
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~ ~~! 1 
41.8 Sk = 0.85, Ex=2.70. 41.9 k = 34): 


7 
41.10 k= = ny 
7 1 


41.11 (a) k= 1 od Joi #20 - 0] 


d/o?, where 4 is an arbitrary number. 





41.12 A; = 
. 1 n ae! nr 
41.13 f=- 2, aS ms Ves 
re es 
E. = phen, —2— ¥ (x = 2 7D, Ge BF Ey = pkn n— 1 > On — ¥)?, 
k=1 


the values of k, being given in Table 23. 


41.14 % = 48.31 m, § = 53.31 m.,, £, = 10.75 m, EF, = 12.50 m. 


41.15 ae 2 Xs ee ar 
pv2 V6? cos? a + Ky, Sin 2« + 62 sin? a: 
pv2 V@2 sin?a — k,y sin 2a + 62 cos? a, 


where 
n 2 1 n = 
> Cee 2s 6 SS DOS: 


E, 
E, 


Il 





Key = 7 — x). - J) 





and angle a is determined from the equation 





tan 2a = = = 
ian 


41.16 x=1m., ¥ = 40m 


ce) fi 





41.17 


First, show that the probability density of the random variable & is determined by 


the formula 
s 2 nm—-1)/2 ees ~\2 

ful@) = ES) (3) ” "rt exp {-2EF. 
2 





41.18 See Table 132. 


TABLE 132 





i; 1-10 | 11~20 | 21-30 | 31-40 | 41-50 | 51-60 | 61-70 | 71-80 | 81-90 | 91-100 


Py °| 0.107 | 0.100 | 0.127 : : 0.127 | 0.093 | 0.073 | 0.087 | 0.106 
F(x) | 0.107 | 0.207 | 0.334 : ; 0.641 | 0.734 | 0.807 | 0.894 | 1.0 


¥ = 48.50, D[LX] = 829.18. 
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41.19 See Table 133. 


TABLE 133 





24-27 27-30 30-33 33-36 36-39 39-42 
rae [aw fo Pa 
X = 22.85, D[LX] = 40.08. 
41.20 6G? and 62 are unbiased estimates of the variance 
(Mis8] = MIs%] = 0%); DIst]= 7; Dyas] = 
that is, D[@?] < D[e2] (see Table 134) for any n > 2. 


4. 
(n— 12°? 





TABLE 134 





42. CONFIDENCE LEVELS AND CONFIDENCE INTERVALS 
42.1 (92.36 m., 107.64 m.). 42.2 X= 116 35 m., (115.53 m.; 116.57 m.). 
42.3 0.55;0.34. 42.4 (a) = 10.57m., 6, = 2.05 m., (b) 0.26, (c) 0.035. 
42.5 (5.249 sec., 5.751 sec.); (1.523 sec., 1.928 sec.). 
42.6 (867.6 m./sec., 873.0 m./sec.). 42.7 Not less than 11 measurements. 
42.8 (24,846 m., 25,154 m.), (130.7 m., 294.9 m.). 
42.9 (4.761-10-1°, 4.805-:10~-1°), = 4.783-10-7°, 


42.10 (a) (420.75 m./sec., 428.65 m./sec.), (6.69 m./sec., 12.70 m./sec.), 
(b) 0.61, 0.76. 


42.11 Not less than three range finders. 
42.12 Not less than 15 measurements. 
42.13 0.44, 0.55, 0.71, 0.91. 42.14 See Table 135. 


TABLE 135 
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42.15 7 = 425 hours, (270.70 hours, 779.82 hours). 

42.16 (410.21 hours, 1036.56 hours). 42.17 (50.75 hours, 85.14 hours), 
42.18 (0.123, 0.459). 42.19 (0.303, 0.503), (0.276, 0.534). 

42.20 (0.000, 0.149), (0.000, 0.206), (0.000, 0.369). 

42.21 For marksman A (0.128, 0.872), for marksman B (0.369, 0.631), 
42.22 (1.15, 3.24). 42.23 (3.721, 4.020). 42.24 (0, 4.6). 


42.25 For « = 0.99 for a = 0.95 
for Tie (0.42, 0.68), for rie (0.45, 0.65), 
for rig (0.13, 0.47), for ry3 (0.17, 0.43), 
for ri4 (0.21, 0.53), for ri4 (0.25, 0.49). 


42.26 9.82 < % < 11.18, 1.624 < oy < 2.632, 70.58 < § < 77.42, 
8.12 < o, < 13.16, 0.369 < ri, < 0.796. 


43. TESTS OF GOODNESS-OF-FIT 


43.1 \ = 0.928, x2 = 2.172, k = 4, P(x? > x2) = 0.705. The deviation is 
insignificant, the hypothesis on agreement of the observations with the Poisson 
distribution law is not contradicted. 


43.2 X = 1.54, x2 = 7.953, k = 6, P(y? > x?) = 0.246. The deviation is in- 
significant. 


43.3 X = 5, p = 0.5, x? = 3.156, k = 9, PQ? > x2) = 0.944. The hypothesis 
that at each shot the probability of hitting is the same is not disproved. 


43.4 x7 = 10.32, k = 7, P(x? > x2) = 0.176. The deviations are insignificant. 


43.5 Dnyy = 0.1068, Anyp = 1.068, P(Anyp) = 0.202, Dein = 0.1401, Avin = 
1.401, PQsin) = 0.039. The hypothesis that the observations agree with a hyper- 
geometric distribution law is not disproved; the deviation of the statistical distribu- 
tion from the binomial is significant and the hypothesis about the binomial 
distribution should be rejected. 

43.6 x = 11.8 g, ¢ = 4.691 g. k = 2, x2 = 1.16, P(y? > x?) = 0.568. The 
hypothesis that the observations obey a normal distribution is not disproved. 

43.7 % = 22.85, 6 = 6.394, k = 6, x2 = 5.939, P(x? > x2) = 0.436. The hypoth- 
esis that the statistical distribution agrees with a normal distribution is not disproved 
since the deviations are insignificant. 

43.8 M[Z] = 4.5, D[Z] = 8.25, where Z is a random digit; 

MLX] = 22.5, DLX] = 41.23, a = 6.423, Dy = 0.0405, 
A = 0.6403, P(A) = 0.807. 
The hypothesis that the statistical distribution agrees with a normal distribution is 
not disproved. 

43.9 x2? = 5.012, k = 9, P(y? > x2) = 0.831. The deviations are insignificant; 
the hypothesis that the first 800 decimals of the number 7 agree with a uniform 
distribution law is not disproved. 


43.10 D>, = 0.0138, A = 0.3903, P(A) = 0.998. The hypothesis that the first 
800, decimals of 7 obey a uniform distribution law is not disproved. 


43.11 x2 = 4,k = 9, PQ? = x2) = 0.91. The hypothesis that the observations 
obey a uniform distribution law is not rejected. 
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43.12 Do = 0.041, X = 0.5021, P(A) = 0.963. The hypothesis that the obser- 
vations agree with a uniform distribution is not rejected since the deviations are 
insignificant. 

43.13 yi = 24.9, k = 9, P(x? > x2) = 0.0034. The deviations are significant; 
the hypothesis that the experimental data agree with a uniform distribution should 
be rejected. The results of the computations contain a systematic error. 

43.14 x = 8.75, & = 16.85, yay = 11.86, ky = 5, P(x? > x2) = 0.0398; an 
estimate of 5 = V66 = 41.28 is obtained for the parameter 5 of the Simpson 
distribution law; y2, = 17.06, k, = 5; P(x? > x2) = 0.00402. The hypothesis that 
the observations agree with the Simpson distribution is rejected and the hypothesis 
that they agree with a normal distribution may be considered not rejected. 

43.15 x =logy, x = —0.1312, 62 = 0.3412, 6, = 0.5841, n=9, k = 6, 
P(y? > x2) = 0.890. The hypothesis that the experimental data obey a logarithmi- 
cally normal distribution law is not disproved (the deviations are insignificant). 








43.16 % = 2.864, m,= 11.469, M[X]=vé, G= re oo 


where v is the root of the equation 
pv) + 0.5vD(r) x 
" Mie Va 

for vy = 1.2, we have T(v) = 0.4200; for vy = 1.3, T(v) = 0.4241; 

vy © 1.271, MLX] = 2.662, & = 2.094, x7 = 5.304, k=9, 

P(y? > x2) = 0.894. 

The hypothesis that X is the absolute value of a normally distributed variable is not 
disproved. 

43.17 x = 87.46, & = 2.471, & = 80.02, B = 94.90, y27 > 500, ky = 7, 
P(y? > x24) ~ 0. The probability density (x) for the convolution of a normal and 
uniform distribution has the form 


Sno x — 80.02 94.90 — x a 
FO) = 577458 [o( 2.471 o( 2.471 )| Kee 212079 


ky = 6, P(x? > x2.) = 0.814. The hypothesis that the experimental data obey a 
normal distribution law is disproved. The hypothesis that the experimental data 
agree with the convolution of a normal distribution and a uniform one is not 
contradicted. 





43.18 * = 50.13, 6 = Ae = 40.0, x2 = 2.73, k = 8, P(x? > x2) = 0.95. 


The hypothesis that the observations agree with a Rayleigh distribution is not 
contradicted. 

43.19 % = 508.6, &6 = 123.7, y2n = 2.95, ky = 7, P(y? => x3u) = 0.888. 
The parameter @ for a Maxwell distribution is determined from the formula 





a= ioe = 193.4, y24 = 1.383, ku =7, P(x? > x3) = 0.986. 


The observations fit a Maxwell distribution better than they fit a normal distribution. 


43.20 f = 871.5 hours, @ = 0.001148, k = 8, y2 = 4.495, P(x? = x2) = 0.808. 
The hypothesis that the observations agree with an exponential distribution law 
is not disproved (the deviations are insignificant). 
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43.21 7 = 394.5 hours, é = 228.1 hours, 8, = 0.5782, # = 1.789, b, = 0.8893, 
x2 = 13.44, k = 7, P(x? = x2) = 0.0629. The hypothesis on the agreement of the 
observations with a Weibull distribution is not disproved. 


43.22 The arctan distribution law is 


F(z) = ii f(z) dz = 5 + * arctan 5° Do = 0.0195, A = 0.6166, 


P(A) = 0.842. 
The hypothesis that the statistical distribution of variable z agrees with a Cauchy 
distribution and, consequently, that of the variable Y with a normal one is not 
disproved. 


43.23 The arcsine distribution function 
F(z) = ; rag eran - Do = 0.0290, = 0.917, P(A) = 0.370. 
vin 


The hypothesis that the pendulum performs harmonic oscillations is not disproved. 


43.24 62 = 0.1211, k = 2, x2 = 1.629, P(y? > x2) = 0.59. The deviations are 
insignificant; the hypothesis that the observed values of g; obey a chi-square distri- 
bution with &’ = 19 degrees of freedom and, consequently, the hypothesis on the 
homogeneity of the series of variances are not disproved. Hint: The values of q 
should be arranged in their increasing order and divided into intervals so that each 
interval contains at least five values q. 


1 


i-ct 


43.25 F(n) = —. D, = 0.126, A=0.797, P(A) = 0.549. 


The hypothesis that the observed values obey a Student’s distribution and, conse- 
quently, the hypothesis that the observed values of x, obey a normal distribution 
law are not rejected. 

43.26 X = 115.3, 6 = 21.43, y2, = 10.20, ky = 10, P(x? = xtu) = 0.43, 
fig = 2046, fig = 6137-102, Sk = 0.2079, Ex = —0.0912. The distribution function 
for a Charlier-A series is: 


F(z) = 0.5 + 0.50(z) — 0.03465p.(z) — 0.0038—@3(z), 
where 


x — 115.3 3 
Z= ay Xion = 8.304, kon = 8, Py? > Xfon) = 0.411. 
The hypotheses on the agreement of the observations with the normal distribution 
and a distribution specified by a Charlier-A series are not disproved and the latter 
does not improve the agreement of the observations with the theoretical distribution 


law. 


43.27 jig = —221.12, fig = 1560-102, Sk = —0.06961, Ex = 0.3406. The 
distribution function for a Charlier-A series is 
F(z) = 0.5 + 0.5(z) + 0.01160p2(z) + 0.01417 pa(z), 


where 


— 299773.85 
ze on ee x2 = 17.25, k=6, P(x? > x2) = 0.0085. 
The deviations are significant. The hypothesis that the observations agree with a 


with a distribution specified by a Charlier-A series is disproved. 


43.28 x2 = 20.48, k = 2, P(x? > x2) = 0.001. The deviations are significant. 
The hypothesis on the independence of the character of the dimensions on the 
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number of the lot is rejected. A systematic underestimate of dimensions is charac- 
teristic for the second lot. 


44. DATA PROCESSING BY THE METHOD OF LEAST SQUARES 


44.1 h = 0.609 + 0.1242E, Mo.o = 0.3896, My. = 0.00001156, 6? = 1.464, 
62, = 0.5704, 62, = 0.0000169. 


44.2 h = 0.679 + 0.124E, 6? = 1.450, 62, = 0.5639, 62, = 0.00001672. The 
coincidence with the results of Problem 44.1 is fully satisfactory. The accuracy of the 
result in Problem 44.2 is higher than in Problem 44.1 since in solving 44.1 a large 
number of computations were performed and among them there occurred sub- 
traction of approximately equal numbers. 


44.3 h = 9.14 + 65.89¢ + 489.2812, 6? = 0.001245, 6, = 1.177 cm./sec.2. 
44.4 h = 65.021 + 5.176Py.19(x)-13 + 1.087Po.13(x)-13, 
where x = 30¢ — 1, or: 
h = 9.133 + 65.895¢ + 489.2827, & = 1.167 cm./sec.?. 
44.5 y = 0.8057 + 0.2004x — 0.1018x?, 6? = 0.0002758, 
Gay = 0.00009192, G, = 0.000009848, 6, = 0.000003283. 
44.6 ¥§ = 26.97 + 0.3012Py.16(t) = 29.38 — 0.3012r, 


¥ = 26.97 + 0.3012Py.16(¢) — 0.000916P2.16(¢) + 0.01718 P3.16(t) 
= 29.82 — 0.7133t + 0.067824? — 0.002864r3, 


where P,,.1¢ are the tabulated values of the Chebyshev polynomials. For a linear 
dependence 6 = 0.3048; for a = 0.90, we have 0.2362 < ao < 0.4380. For a depen- 
dence of third degree, ¢ = 0.1212; for a = 0.90, we have 0.0924 < o < 0.1800. 


44.7 § = 21.07 + 5.954x, 6, = 2.90, 6, = 0.0889, Kaya, = —0.2041. The 
confidence intervals for a, for « = 0.90 are: 14.3 < ag < 27.9, 5.75 < ay < 6.16. 
62(x) = 2.900 — 0.4082x + 0.0889x?. The confidence limits for y = F(x) for 
a = 0.90 are given in Table 136. 


TABLE 136 






i 






Bi — ye,(x1) 


Vi + yGy(%1) 


44.8 J = 0.3548 + 0.06574x + 0.00130x?; G., = 0.0147; é., = 0.0106; 
Sa, = 0.00156. 


bs 
Il 


8.9734 
x 


fora = 0.95, we have: 1.065 < ao < 1.172, 8.831 < a, < 9.1152 Raya: = —0.0854. 
The confidence limits for y = F(x) if « = 0.95 are given in Table 137. 


44.9 y= 1.1188 + 





> Ga = 0.2316, Ga, = 0.6157, 
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TABLE 137 
xt 
vi — v(x) 
M+ yvFy(x) 








2(x) = 0.05364 — 


0.1708 , 0.3790, 
x 


44.10 U = 100.8e~ °-9127¢, 89.97 < Up < 112.9, 0.2935 < a < 0.3319. 


34205 7 : s 
a? Gag = 4.36, Ga, = 504. 





44.11 3, = 204’.9 — 


on 2 
44.12 p = 0.1822 exp Oey \emax| = 0.04633, 


Py = oie = 0.1854. 


44.13 y’ = 62° is chosen according to the formula y = a’ sin (wt — 9’), where 


ag’ = 1e.05| + [Yous] + |¥o.98] Louse + I¥ossl 33, y = 30,75 sin (wt — 59°59), 


|¥ — ylmex = 18°.4. 
44.14 ¥ = 1.0892 — 1.2496 cos x + 2.0802 sin x 
+ 0.9795 cos 2x + 0.4666 sin 2x, 
lemax| = 0.24 for x = 120°. 


44.15 9 = —3.924 + 1,306x; |emax| = 1.41. 


45. STATISTICAL METHODS OF QUALITY CONTROL 


45.1 For a single sample a = 0.0323, B = 0.0190; for a double sample 
« = 0.0067, 8 = 0.0100. The average expenditure of items for 100 lots in the case 
of a double sample is 48.36-15 + 51.64-30 = 2275 items. The expenditure for 100 
lots in the case of single sampling is 2200 items. The expenditure of items is almost 
the same, but in the case of double sampling the probabilities of errors in « and 8 
are considerably smaller. A = 30.38, B = 0.01963, log A = 1.4825, log B = — 1.7069. 
For a good lot ifp = 0, #min = 13; log y (12, 0) = — 1.6288, log y (13, 0) = —1.7771. 
For a defective lot when p = 1, min = 2, log y(1, 1) = 0.8451, log y (2, 2) = 1.9590. 

45.2 Forasingle sample « = 0.049, 8 = 0.009; for a double sample « = 0.046, 
B = 0.008, A = 19.8, B= 0.01053, h, = —3.758, he = 2.424, hg = 0.02915; 
M[x | po) = 244.2, M[x | pi] = 113.6, M[v]max = 321.9. For 100 lots in the case 
of double sampling, the average expenditure of items is 35.1-220 + 64.9-440 = 
36,278 items; in the case of single sampling, the average expenditure is 41,000 items. 
In the case of sequential analysis, the average expenditure for 100 good lots is not 
greater than 24,420 items. 


45.3 The normal distribution is applicable: a = 0.0023, 8 = 0.0307, A = 
415.9, B = 0.03077, hy = —4.295, ho = 7.439, hg = 0.1452. For a good lot if p = 0, 
Nin = 30; for a defective lotifp = 1, Amin = 9; M[n | 0.10] = 94.52, M[n | 0.20] = 
128.9, M[”]max = 257.4, ¢ = 2.153, P(n < 300) = 0.9842, P(n < 150) = 0.8488. 
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45.4 (a) mo = 285, » = 39 (a normal distribution is applicable); 4 = 98, 
B = 0.0202, hy = — 4.814, hp = 5.565, hg = 0.1452; M[x | po] = 102.1, M[n | p,] = 
101.0; M[z]}max = 219.4; (b) m9 = 65, v = 8; A = 8, B= 0.2222, Ay — 1.861, 
hg = 2.565, hs = 0.1452; M[n | po] = 21.6, M[x | pi) = 38.6; M[v)max = 38.6. 

45.5 Apply the passage from a Poisson distribution to a chi-square distribu- 
tion: vy = 9, m = 180, A= 18, B= 0.1053, Ay = —2.178, he = 2.796, hz = 
0.05123; M[x | po] = 90.86, M[x | p,] = 79.82, M[n]mex = 125.2. For a good lot 
if p = 0, we have Amin = 43, for a defective lot if p = 1, mmin = 3. 


21-a71-p, + 21-821-p ze Zi-q@ + Z1~- 7 
45.6 2 = ————————, no = (1 + =)(-——* 4} . 
Zi-a@ + Z1-8 2 Neipy Z1-p, 


where z, are the quantiles of the normal distribution: F(z,) = 0.5 + 0.5®(z,) = p, 
Zo.07 = 1.881, Zo.92 = 1.405; Zo.95 = 1.645, Zo.90 — 1.282, Zo = 1.613, Ag = 87. 
The single sample size in the case of magnitude control for the same «, B, po, p: is 
considerably smaller than in the case of control of the proportion of defectives. 


45.7 In the case of a binomial distribution law (with passage to the normal 
distribution law) @ = 0.1403, B = 0.1776, no = 49, v = 6, A = 5.864, B = 0.2065, 
hy = —1.945, ho = 2.182, hg = 0.1452, M[x | po] = 30.3, M[x | pi] = 26.4, MIA] max 
= 34.2. The average expenditure in the case of double sampling for 100 lots repre- 
sents 64.34-30 + 35.66-60 = 4070 items. In the case of single sampling, the expendi- 
ture of items for 100 lots is 4900 items; in the case of sequential analysis, the average 
expenditure for 100 good lots is not greater than 3030 items. In the case of a Poisson 
distribution, « = 0.1505, 8 = 0.2176, mp = 49, v = 6 (passage to a chi-square 
distribution). 


45.8 Apply the normal distribution law: mp = 286, v = 15, A = 9900, 
B = 0.01, hy = 3.529, hg = 7.052, h = 0.04005, M[x | 0.02] = 176.0, M[x | 0.07] = 
231.9, M[”]max = 647.1, c = 3.608, P(n < M[n| 0.02]) = 0.5993, P(n < 2M[x | 0.02]) 
= 0.9476, P(n < no) = 0.8860. 

45.9 For no = 925, v = 12. For fo = 1000 hours, A = —2.197, B = 2.197, 
ty = 237.6, tg = —237.6, tg = 74.99; M[T | 10-5] = 613.2, M[T| 2-10-5] = 482.9, 
M[T]mex = 750.6. 


TABLE 138 


to, hours 500 1000 2000 5000 





No 1849 925 463 185 


45.10 For the method of single sampling, apply the passage from a Poisson 
distribution to a chi-square distribution: v = 6, m) = 122, A = 184, B = — 0.08041, 
hy = — 1.487, hg = 3.077, hg = 0.0503. For a good lot, if p = 0, mmin = 30; for a 
defective lot, if p = 1, Mmin = 4. 

M[n | 0.02] = 48.3, M[n | 0.10] = 54.6, M[n]}max = 95.9, c = 5.286; 
P(n < no) = 0.982, P(x < 5 ne] = 0.714. 

45.11 Fora double sample « = 0.001486, 8 = 0.0009152; for a single sample 
No = 62, v = 13 (the passage to the normal distribution law); A = 671.0, B= 
0.0009166, hk, = —4.446, hp = 4.043, hg = 0.2485, M[n | ao] = 29.2, M[n | ai] = 
16.0, M[”]max = 70.7. The average expenditure of potatoes per 100 lots in the case 
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of double sampling is 62.88-40 + 37.12.60 = 4743 items. The expenditure of 
potatoes per 100 lots is 6200 items. In the case of sequential analysis, the average 
expenditure per 100 good lots is not greater than 2920 items. 


45.12 For a double sample, a = 0.0896, 8 = 0.0233; for a single sample, 
No = 15,v = 12.45; A = 10.90, B = 0.02560, hy = —977.7, hg = 637.2, h3 = 184.9; 
M[x | oo) = 9.81, M[a | 01] = 2.78, M[n]max = 10. In the case of double sampling, 
the average expenditure of resistors per 100 good lots is 85.66-13 + 14.44.26 = 
1488; in the case of single sampling, the expenditure is 1500 items; in the case of 
sequential analysis, the average expenditure is not larger than 981 items. 


45.13 Inthecase of single sampling, a = 0.0000884, 8 = 0.00621, B = 0.00621, 
A = 1124-10, hy = 6.506, hp = — 11.94, hg = 5.15; M[n | 0] = 26.02; M[n | €,] = 
47.32, M[n)max = 121.4, ¢ = 2.542, P(n < 300) > 0.99(< 0.999); P(x < 150) = 
0.9182. 

45.14 1m = 86, v = 66.7 hours, A= 999, B=0.001001, Ay 
hg = — 690.8, hg = 69.33, A* = 0.01442, M[n| Ao) = 22.48, M[n| A] 
M[“]max = 99.31. 

45.15 For a single control of proportion of unreliable condensers np = 246, 


v = 5. For a sequential reliability control of condensers A = 9999, B = 0.0001, 
Ay = 1152-104, Ap = —1152-10*, Ag = 6384-107, A* = 0.000001566. 


45.16 tp = 952.6 hours, v = 72.8 hours, In A = 2.197, In B = —2.197, 


690.8, 
35.67, 


2 In AToT, = - In BToT, ae 
th = TT, * 219.7 hours, to = TT, ~ 219.7 hours, 
ToT In a 
oy ee 
ty = TT, 69.3 hours. 


For the poorer of the. good lots (T = To = 100)tain = 715.7 hours; for the better 
of the defective lots (T = 7, = 50)tmin = 569.2 hours. 


46. DETERMINATION OF PROBABILITY CHARACTERISTICS OF 
RANDOM FUNCTIONS FROM EXPERIMENTAL DATA 


46.1 One should prove that if X = (1/T) ih x(t) dt, then M[X] = x, 
limp. o D[X] = 0. 
46.2 No, since lime... M[S,(w)] = S.(w), but D[LS,(w)] = S$2(w) and, conse- 
quently, does not tend to zero as T increases. 
I 2 T-t 
46.3 D[K.(7)] = a= | (T - t= 71) 
x [Ki(r1) + Ki(m1 + 7)Kit1 — 7) dry. 


T+ 
46.4 MIK,(1)] = K(n) — oF ip (Pager Ges 


fe 
MR] = KG) ~ qos [T= KG + dens 
DIR) = qe f(T = — IK) + KG + KG — Dd 


ree sae [ [Pe = Ker) dr]? Sa ee 
(T — 1)* 0 : ‘ ‘ (Cl =34)° 


T—t TT T= 
x i I i K(t3 — ty)K(te — ty — 7) dt, dtz dta; 
(a) 0 oO 
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T- 


is Zz . 
DIKAM)] = FP i (Tees) 
x [K%(71) + K(r, + T)K(7, — 7) 
+ K(r)K(r + 71) + K(D)K(n — 7)) ari 


2 io: T-1 Tt 
Be ieee 5 I [ I [K(te — ty) K(ts — h) + K(te — 4 +7) 
x K(t3 =A = 7)] dt dtz dts 


2 T-t 2 
T= {[, (T~ 7 — m)IKGr + 7) + Kr — 7)] ars} 
4 T-t 2 
a (T — 7)! {[, (T-7- 71) K(71) ars} 


4 T= 2 
= aot], (T — 7 — 1)K(r + 71) ar, ; 


2 ~— e7~e 
46.5 D[%] = “ ( = —). 
a 
46.6 D[S(w)] = — [. (T - 1) 
x {| [K(t +n) + K(t — n)] sin (T — n)w dy 


+ 





T 
| e *®K(t — 1) dr 





2 
} ar 


46.7 oc, will decrease by 2 per cent. 46.8 7, will decrease by 3 per cent. 

46.9 D[K,(7) = 22 grad.*, D[K,(3)] = 2.8 grad.*. 

46.10 The value of the first zero of the function K(r) equals (a) 2.26 sec., 
(b) 2.30 sec. 


az 
46.11 D[K,(7)] = UF) 
x {ara + [ar cos 2Br + ain 2Br + : 
se cosmeete = COs 2B = i 2}, 


D[K,(0)] = 5.82 grad.*, D[K,(2.09)] = 5.35 grad.*, 
D[K,(4.18)] = 4.80 grad.*, D[K,(16.72)] = 2.92 grad.* 
and the corresponding standard deviations are 2.41, 2.32, 2.19 and 1.71 grad.?. 


46.12 When f increases the quotient, ¢,/f converges in probability to the proba- 
bility P of coincidence of the signs of the ordinates of the random functions X(t) 
and X(t + 7), related, for a normal process, to the normalized correlation function 
k(r) by k(r) = cos (1 — P), which can be proved by integrating the two-dimensional 
normal distribution law of the ordinates of the random function between proper 
limits. 


46.13 Denoting by 
aa XOX +) 
ys f + xx + | 


and by P the probability that the signs of X(t) and X(t + 7) coincide, we get Z = P; 
kA) = cosa(1 — 2) © cosa(1 — 2) + a(Z — Z)sina(I — 2). 
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Consequently, 
D[k(7)] = 7?D[Z] sin? 71 — P) = 7?[1 — k2(7)]D[Z]; 


> fT 
Diz) = a [7 — 1K) dr 
fo) fo) [0] foe) foo) o ie] 0 0 0 ie) 0 
Fe ee 
ie) ie) i] QO is) it) -@ —-@ -o —-@ —- ao -@ 
+f i in [bile es x0, 0) des die di dna — ®, 


f (x1, X2, X3, X4) being the distribution law of the system of normal variables X(t1), 
X(t; + 7), X(te), X(t2 + 7). 


46.14 Kr) = @:Ri(7) + 22K2(r) + gaKa(r), where we have the approximate 
reaction: 


1 

a2 : 2 ft 

&j = ri at C= 1.2.39); of = z | i= 1)K,(7) dt. 
of = ahs 


For T; exceeding considerably the damping time of K,(7), it is approximately true 


that 
a ee 
ONE, T,] 


where 6 = [> +K(z) dz and K(r) is a sample function. 


m-l-1 
46.15 D[K,(7)] = aor > [K2(sA) + K.(sd + IA)K,(sA — 1A)] 


l 


x (m —1- s)+ — ; [K200) + R2(IA)]. 





m 
46.16 By 9 per cent. 





T T 5 
46.17 a = al K,(1) drt; ay = =a) K,,.(1r) cos mat dr, j>9; 
0 0 


T m 
Nee = I K2(r) dr — Tes — Z > a}. 
0 2 i= 
46.18 Since 
S bf d 
j= al I(t) dt, 
then 
py] = 22 [1 — La — e-#7)| = of = 0.86- 10-2242. 
aT aT 


The mean error is £; = pv2 a; = 0.58-1078A. 


2T. 


3T. 
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1 
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eee = 1 ca 
distribution: P(y < qvk) = remraes |, peole-v22 dy: Beyer, W. 
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